Max level shown:
12024-11-14T00:30:00.946ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2540 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = 5ff6459c-ccfd-4597-ad42-bc537164eb76 response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
22024-11-14T00:30:02.817ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32024-11-14T00:30:02.818ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42024-11-14T00:30:02.821ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
52024-11-14T00:30:02.821ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
62024-11-14T00:30:02.823ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
72024-11-14T00:30:02.825ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
82024-11-14T00:30:02.825ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
92024-11-14T00:30:02.826ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
102024-11-14T00:30:02.828ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
112024-11-14T00:30:02.828ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
122024-11-14T00:30:02.830ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
132024-11-14T00:30:02.831ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
142024-11-14T00:30:02.832ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
152024-11-14T00:30:02.832ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
162024-11-14T00:30:02.835ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
172024-11-14T00:30:02.836ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
182024-11-14T00:30:02.837ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
192024-11-14T00:30:02.837ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
202024-11-14T00:30:02.839ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
212024-11-14T00:30:02.840ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
222024-11-14T00:30:02.840ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
232024-11-14T00:30:02.840ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
242024-11-14T00:30:02.846ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
252024-11-14T00:30:02.846ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
262024-11-14T00:30:02.848ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
272024-11-14T00:30:02.848ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
282024-11-14T00:30:02.850ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
292024-11-14T00:30:02.850ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
302024-11-14T00:30:02.852ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
312024-11-14T00:30:02.852ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
322024-11-14T00:30:02.853ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
332024-11-14T00:30:02.855ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
342024-11-14T00:30:02.855ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
352024-11-14T00:30:02.855ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
362024-11-14T00:30:02.856ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
372024-11-14T00:30:02.856ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
382024-11-14T00:30:02.858ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
392024-11-14T00:30:02.858ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
402024-11-14T00:30:02.859ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
412024-11-14T00:30:02.860ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
422024-11-14T00:30:02.860ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
432024-11-14T00:30:02.860ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
442024-11-14T00:30:02.862ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
452024-11-14T00:30:02.863ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
462024-11-14T00:30:02.865ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
472024-11-14T00:30:02.865ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
482024-11-14T00:30:02.868ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
492024-11-14T00:30:02.869ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
502024-11-14T00:30:02.871ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
512024-11-14T00:30:02.871ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
522024-11-14T00:30:02.873ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
532024-11-14T00:30:02.873ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
542024-11-14T00:30:02.876ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
552024-11-14T00:30:02.876ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
562024-11-14T00:30:02.879ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
572024-11-14T00:30:02.882ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
582024-11-14T00:30:02.882ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
592024-11-14T00:30:02.882ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
602024-11-14T00:30:02.885ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
612024-11-14T00:30:02.885ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
622024-11-14T00:30:02.888ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
632024-11-14T00:30:02.888ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
642024-11-14T00:30:02.890ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
652024-11-14T00:30:02.890ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
662024-11-14T00:30:02.893ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
672024-11-14T00:30:02.897ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
682024-11-14T00:30:02.897ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
692024-11-14T00:30:02.897ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
702024-11-14T00:30:02.900ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 82982 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 77979fa2-1394-4314-9286-8a6b1673faf0 response_code = 200 uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
712024-11-14T00:30:03.155ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
722024-11-14T00:30:03.155ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
732024-11-14T00:30:03.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
742024-11-14T00:30:03.155ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
752024-11-14T00:30:03.155ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
762024-11-14T00:30:03.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
772024-11-14T00:30:03.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
782024-11-14T00:30:03.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
792024-11-14T00:30:03.159ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
802024-11-14T00:30:03.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
812024-11-14T00:30:03.161ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
822024-11-14T00:30:03.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
832024-11-14T00:30:03.163ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
842024-11-14T00:30:03.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
852024-11-14T00:30:03.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
862024-11-14T00:30:03.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
872024-11-14T00:30:03.176ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
882024-11-14T00:30:03.176ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.982435ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
892024-11-14T00:30:03.184ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
902024-11-14T00:30:03.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
912024-11-14T00:30:03.218ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.503009ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
922024-11-14T00:30:06.185ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6bdd91db-0ac1-432e-9911-adc299e0d6ec", "date": "Thu, 14 Nov 2024 00:30:06 GMT"} })
932024-11-14T00:30:06.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
942024-11-14T00:30:06.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
952024-11-14T00:30:06.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
962024-11-14T00:30:06.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
972024-11-14T00:30:06.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
982024-11-14T00:30:06.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
992024-11-14T00:30:06.195ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1002024-11-14T00:30:06.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1012024-11-14T00:30:06.197ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1022024-11-14T00:30:06.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1032024-11-14T00:30:06.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1042024-11-14T00:30:06.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1052024-11-14T00:30:06.204ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1062024-11-14T00:30:06.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1072024-11-14T00:30:06.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1082024-11-14T00:30:06.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1092024-11-14T00:30:06.208ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1102024-11-14T00:30:06.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1112024-11-14T00:30:06.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1122024-11-14T00:30:06.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1132024-11-14T00:30:06.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1142024-11-14T00:30:06.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1152024-11-14T00:30:06.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1162024-11-14T00:30:06.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1172024-11-14T00:30:06.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1182024-11-14T00:30:06.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1192024-11-14T00:30:06.218ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1202024-11-14T00:30:06.222ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::1:0]:39170
1212024-11-14T00:30:06.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ById(17b1ded6-f8f1-45cb-8443-dafcf0963e1d) }, key: bffc383e-a189-4062-ba8b-2f71d77ef06e, lookup_type: ById(bffc383e-a189-4062-ba8b-2f71d77ef06e) }, key: 7b89b865-b3ed-4821-b4a5-5eac407c7914, lookup_type: ById(7b89b865-b3ed-4821-b4a5-5eac407c7914) } result = Ok(())
1222024-11-14T00:30:06.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1232024-11-14T00:30:06.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:39170 req_id = 3968d69f-e281-4025-aea6-5fd9c4583c23 roles = RoleSet { roles: {} } uri = /metrics/producers
1242024-11-14T00:30:06.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1252024-11-14T00:30:06.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:39170 req_id = 3968d69f-e281-4025-aea6-5fd9c4583c23 resource = Database result = Ok(()) uri = /metrics/producers
1262024-11-14T00:30:06.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1272024-11-14T00:30:06.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1282024-11-14T00:30:06.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1292024-11-14T00:30:06.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1302024-11-14T00:30:06.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1312024-11-14T00:30:06.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ById(17b1ded6-f8f1-45cb-8443-dafcf0963e1d) }, key: bffc383e-a189-4062-ba8b-2f71d77ef06e, lookup_type: ById(bffc383e-a189-4062-ba8b-2f71d77ef06e) }, key: 7b89b865-b3ed-4821-b4a5-5eac407c7914, lookup_type: ById(7b89b865-b3ed-4821-b4a5-5eac407c7914) } result = Ok(())
1322024-11-14T00:30:06.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1332024-11-14T00:30:06.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1342024-11-14T00:30:06.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1352024-11-14T00:30:06.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1362024-11-14T00:30:06.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1372024-11-14T00:30:06.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1382024-11-14T00:30:06.235ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1392024-11-14T00:30:06.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1402024-11-14T00:30:06.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1412024-11-14T00:30:06.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1422024-11-14T00:30:06.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1432024-11-14T00:30:06.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1442024-11-14T00:30:06.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1452024-11-14T00:30:06.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1462024-11-14T00:30:06.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1472024-11-14T00:30:06.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1482024-11-14T00:30:06.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1492024-11-14T00:30:06.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ById(17b1ded6-f8f1-45cb-8443-dafcf0963e1d) }, key: bffc383e-a189-4062-ba8b-2f71d77ef06e, lookup_type: ById(bffc383e-a189-4062-ba8b-2f71d77ef06e) }, key: 56c27358-fab8-45ee-af72-5739c9f9ac8c, lookup_type: ByName("default") } result = Ok(())
1502024-11-14T00:30:06.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1512024-11-14T00:30:06.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1522024-11-14T00:30:06.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1532024-11-14T00:30:06.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1542024-11-14T00:30:06.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1552024-11-14T00:30:06.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1562024-11-14T00:30:06.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1572024-11-14T00:30:06.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1582024-11-14T00:30:06.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1592024-11-14T00:30:06.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1602024-11-14T00:30:06.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1612024-11-14T00:30:06.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1622024-11-14T00:30:06.260ZINFOnexus: assigned collector to new producer collector_id = ad042fde-503a-4314-8c8c-afa2f783d145 file = nexus/src/app/oximeter.rs:76 producer_id = e21ef448-9c04-42c3-96f9-7b85864c1212
1632024-11-14T00:30:06.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38425 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:39170 req_id = 3968d69f-e281-4025-aea6-5fd9c4583c23 response_code = 201 uri = /metrics/producers
1642024-11-14T00:30:06.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1652024-11-14T00:30:06.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1662024-11-14T00:30:06.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1672024-11-14T00:30:06.266ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::1]:39971
1682024-11-14T00:30:06.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ById(17b1ded6-f8f1-45cb-8443-dafcf0963e1d) }, key: bffc383e-a189-4062-ba8b-2f71d77ef06e, lookup_type: ById(bffc383e-a189-4062-ba8b-2f71d77ef06e) }, key: 5cd95a7a-5161-4989-87c2-490595c65b91, lookup_type: ByName("default") } result = Ok(())
1692024-11-14T00:30:06.267ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
1702024-11-14T00:30:06.267ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
1712024-11-14T00:30:06.267ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c4ef78b5-173e-4c4f-86ef-344e3db14a82", "date": "Thu, 14 Nov 2024 00:30:06 GMT"} })
1722024-11-14T00:30:06.269ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 8.642881583s iteration = 25 status = {}
1732024-11-14T00:30:06.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39971 req_id = 0136d84d-05f1-4a31-a231-c471335a8a4e roles = RoleSet { roles: {} } uri = /probes/e211d163-be78-4663-b73f-baf5e9462a10
1742024-11-14T00:30:06.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39971 req_id = 0136d84d-05f1-4a31-a231-c471335a8a4e resource = Database result = Ok(()) uri = /probes/e211d163-be78-4663-b73f-baf5e9462a10
1752024-11-14T00:30:06.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 6924 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:39971 req_id = 0136d84d-05f1-4a31-a231-c471335a8a4e response_code = 200 uri = /probes/e211d163-be78-4663-b73f-baf5e9462a10
1762024-11-14T00:30:07.903ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1772024-11-14T00:30:07.903ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1782024-11-14T00:30:07.905ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1792024-11-14T00:30:07.905ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1802024-11-14T00:30:07.907ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1812024-11-14T00:30:07.908ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
1822024-11-14T00:30:07.908ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1832024-11-14T00:30:07.908ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1842024-11-14T00:30:07.910ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1852024-11-14T00:30:07.911ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1862024-11-14T00:30:07.912ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1872024-11-14T00:30:07.912ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1882024-11-14T00:30:07.914ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1892024-11-14T00:30:07.914ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1902024-11-14T00:30:07.916ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1912024-11-14T00:30:07.917ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
1922024-11-14T00:30:07.917ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1932024-11-14T00:30:07.917ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1942024-11-14T00:30:07.919ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1952024-11-14T00:30:07.920ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
1962024-11-14T00:30:07.920ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1972024-11-14T00:30:07.920ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1982024-11-14T00:30:07.926ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1992024-11-14T00:30:07.926ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2002024-11-14T00:30:07.927ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2012024-11-14T00:30:07.928ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2022024-11-14T00:30:07.929ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2032024-11-14T00:30:07.929ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2042024-11-14T00:30:07.930ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2052024-11-14T00:30:07.931ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2062024-11-14T00:30:07.932ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2072024-11-14T00:30:07.933ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
2082024-11-14T00:30:07.933ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2092024-11-14T00:30:07.933ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2102024-11-14T00:30:07.935ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2112024-11-14T00:30:07.935ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2122024-11-14T00:30:07.936ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2132024-11-14T00:30:07.936ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2142024-11-14T00:30:07.937ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2152024-11-14T00:30:07.938ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
2162024-11-14T00:30:07.938ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2172024-11-14T00:30:07.939ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2182024-11-14T00:30:07.940ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2192024-11-14T00:30:07.940ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2202024-11-14T00:30:07.942ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2212024-11-14T00:30:07.942ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2222024-11-14T00:30:07.943ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2232024-11-14T00:30:07.944ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2242024-11-14T00:30:07.945ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2252024-11-14T00:30:07.945ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2262024-11-14T00:30:07.948ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2272024-11-14T00:30:07.948ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2282024-11-14T00:30:07.950ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2292024-11-14T00:30:07.950ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2302024-11-14T00:30:07.953ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2312024-11-14T00:30:07.955ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2322024-11-14T00:30:07.955ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2332024-11-14T00:30:07.956ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2342024-11-14T00:30:07.958ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2352024-11-14T00:30:07.958ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2362024-11-14T00:30:07.960ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2372024-11-14T00:30:07.960ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2382024-11-14T00:30:07.963ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2392024-11-14T00:30:07.963ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2402024-11-14T00:30:07.965ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2412024-11-14T00:30:07.968ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2422024-11-14T00:30:07.968ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2432024-11-14T00:30:07.968ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2442024-11-14T00:30:07.970ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67429 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = df003755-7c76-4918-9b5a-c3ae79dfcd9b response_code = 200 uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
2452024-11-14T00:30:07.971ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2462024-11-14T00:30:07.972ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2472024-11-14T00:30:07.973ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2482024-11-14T00:30:07.973ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2492024-11-14T00:30:07.974ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2502024-11-14T00:30:07.975ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
2512024-11-14T00:30:07.975ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2522024-11-14T00:30:07.975ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2532024-11-14T00:30:07.976ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2542024-11-14T00:30:07.976ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2552024-11-14T00:30:07.978ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2562024-11-14T00:30:07.978ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2572024-11-14T00:30:07.979ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2582024-11-14T00:30:07.979ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2592024-11-14T00:30:07.980ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2602024-11-14T00:30:07.981ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
2612024-11-14T00:30:07.981ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2622024-11-14T00:30:07.982ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2632024-11-14T00:30:07.983ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2642024-11-14T00:30:07.984ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
2652024-11-14T00:30:07.984ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2662024-11-14T00:30:07.984ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2672024-11-14T00:30:07.988ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2682024-11-14T00:30:07.988ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2692024-11-14T00:30:07.989ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2702024-11-14T00:30:07.989ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2712024-11-14T00:30:07.990ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2722024-11-14T00:30:07.990ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2732024-11-14T00:30:07.991ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2742024-11-14T00:30:07.992ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2752024-11-14T00:30:07.992ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2762024-11-14T00:30:07.994ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
2772024-11-14T00:30:07.994ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2782024-11-14T00:30:07.994ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2792024-11-14T00:30:07.995ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2802024-11-14T00:30:07.995ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2812024-11-14T00:30:07.997ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2822024-11-14T00:30:07.997ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2832024-11-14T00:30:07.998ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2842024-11-14T00:30:07.999ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
2852024-11-14T00:30:07.999ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
2862024-11-14T00:30:07.999ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
2872024-11-14T00:30:08.001ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
2882024-11-14T00:30:08.001ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
2892024-11-14T00:30:08.002ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
2902024-11-14T00:30:08.002ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
2912024-11-14T00:30:08.004ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
2922024-11-14T00:30:08.005ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
2932024-11-14T00:30:08.007ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
2942024-11-14T00:30:08.007ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
2952024-11-14T00:30:08.009ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
2962024-11-14T00:30:08.009ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
2972024-11-14T00:30:08.012ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
2982024-11-14T00:30:08.012ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
2992024-11-14T00:30:08.014ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3002024-11-14T00:30:08.016ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3012024-11-14T00:30:08.016ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3022024-11-14T00:30:08.016ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3032024-11-14T00:30:08.019ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3042024-11-14T00:30:08.019ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3052024-11-14T00:30:08.021ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3062024-11-14T00:30:08.021ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3072024-11-14T00:30:08.024ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3082024-11-14T00:30:08.024ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3092024-11-14T00:30:08.026ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3102024-11-14T00:30:08.029ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3112024-11-14T00:30:08.029ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3122024-11-14T00:30:08.029ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3132024-11-14T00:30:08.069ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 97241 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 5392d0a2-bf5d-4cf2-b23f-147990b0b888 response_code = 200 uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
3142024-11-14T00:30:13.155ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
3152024-11-14T00:30:13.155ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3162024-11-14T00:30:13.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3172024-11-14T00:30:13.156ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
3182024-11-14T00:30:13.156ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3192024-11-14T00:30:13.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3202024-11-14T00:30:13.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3212024-11-14T00:30:13.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3222024-11-14T00:30:13.159ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3232024-11-14T00:30:13.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3242024-11-14T00:30:13.161ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3252024-11-14T00:30:13.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3262024-11-14T00:30:13.163ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3272024-11-14T00:30:13.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
3282024-11-14T00:30:13.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3292024-11-14T00:30:13.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3302024-11-14T00:30:13.177ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
3312024-11-14T00:30:13.177ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.262673ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
3322024-11-14T00:30:13.184ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3332024-11-14T00:30:13.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3342024-11-14T00:30:13.186ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.278995ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3352024-11-14T00:30:13.497ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3362024-11-14T00:30:13.497ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3372024-11-14T00:30:13.498ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3382024-11-14T00:30:13.498ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3392024-11-14T00:30:13.500ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3402024-11-14T00:30:13.501ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
3412024-11-14T00:30:13.501ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3422024-11-14T00:30:13.502ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3432024-11-14T00:30:13.503ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3442024-11-14T00:30:13.503ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3452024-11-14T00:30:13.505ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3462024-11-14T00:30:13.505ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3472024-11-14T00:30:13.506ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3482024-11-14T00:30:13.507ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3492024-11-14T00:30:13.508ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3502024-11-14T00:30:13.509ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
3512024-11-14T00:30:13.509ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3522024-11-14T00:30:13.509ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3532024-11-14T00:30:13.511ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3542024-11-14T00:30:13.512ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
3552024-11-14T00:30:13.512ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3562024-11-14T00:30:13.512ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3572024-11-14T00:30:13.519ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3582024-11-14T00:30:13.520ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3592024-11-14T00:30:13.521ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3602024-11-14T00:30:13.521ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3612024-11-14T00:30:13.522ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3622024-11-14T00:30:13.523ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3632024-11-14T00:30:13.524ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3642024-11-14T00:30:13.524ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3652024-11-14T00:30:13.525ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3662024-11-14T00:30:13.527ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
3672024-11-14T00:30:13.527ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3682024-11-14T00:30:13.527ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3692024-11-14T00:30:13.528ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3702024-11-14T00:30:13.528ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3712024-11-14T00:30:13.529ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3722024-11-14T00:30:13.529ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3732024-11-14T00:30:13.531ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
3742024-11-14T00:30:13.532ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
3752024-11-14T00:30:13.532ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3762024-11-14T00:30:13.532ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3772024-11-14T00:30:13.533ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3782024-11-14T00:30:13.533ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3792024-11-14T00:30:13.535ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3802024-11-14T00:30:13.535ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3812024-11-14T00:30:13.536ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3822024-11-14T00:30:13.537ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3832024-11-14T00:30:13.538ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3842024-11-14T00:30:13.538ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3852024-11-14T00:30:13.541ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3862024-11-14T00:30:13.541ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3872024-11-14T00:30:13.543ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3882024-11-14T00:30:13.544ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3892024-11-14T00:30:13.546ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3902024-11-14T00:30:13.548ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3912024-11-14T00:30:13.548ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3922024-11-14T00:30:13.549ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3932024-11-14T00:30:13.551ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3942024-11-14T00:30:13.551ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3952024-11-14T00:30:13.552ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3962024-11-14T00:30:13.553ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3972024-11-14T00:30:13.555ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3982024-11-14T00:30:13.555ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
3992024-11-14T00:30:13.557ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
4002024-11-14T00:30:13.560ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
4012024-11-14T00:30:13.560ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
4022024-11-14T00:30:13.560ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
4032024-11-14T00:30:13.562ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 65961 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 38e15395-003c-4570-81c5-8e48cb526762 response_code = 200 uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
4042024-11-14T00:30:13.564ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4052024-11-14T00:30:13.564ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4062024-11-14T00:30:13.565ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4072024-11-14T00:30:13.565ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4082024-11-14T00:30:13.566ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4092024-11-14T00:30:13.567ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
4102024-11-14T00:30:13.567ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4112024-11-14T00:30:13.567ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4122024-11-14T00:30:13.568ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4132024-11-14T00:30:13.568ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4142024-11-14T00:30:13.570ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4152024-11-14T00:30:13.570ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4162024-11-14T00:30:13.571ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4172024-11-14T00:30:13.571ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4182024-11-14T00:30:13.572ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4192024-11-14T00:30:13.574ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
4202024-11-14T00:30:13.574ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4212024-11-14T00:30:13.574ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4222024-11-14T00:30:13.575ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4232024-11-14T00:30:13.576ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
4242024-11-14T00:30:13.576ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4252024-11-14T00:30:13.576ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4262024-11-14T00:30:13.580ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4272024-11-14T00:30:13.580ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4282024-11-14T00:30:13.582ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4292024-11-14T00:30:13.582ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4302024-11-14T00:30:13.583ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4312024-11-14T00:30:13.583ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4322024-11-14T00:30:13.584ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4332024-11-14T00:30:13.584ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4342024-11-14T00:30:13.585ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4352024-11-14T00:30:13.586ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
4362024-11-14T00:30:13.586ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4372024-11-14T00:30:13.587ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4382024-11-14T00:30:13.588ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4392024-11-14T00:30:13.588ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4402024-11-14T00:30:13.589ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4412024-11-14T00:30:13.589ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4422024-11-14T00:30:13.591ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4432024-11-14T00:30:13.592ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
4442024-11-14T00:30:13.592ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4452024-11-14T00:30:13.592ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4462024-11-14T00:30:13.593ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4472024-11-14T00:30:13.593ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4482024-11-14T00:30:13.594ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4492024-11-14T00:30:13.595ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4502024-11-14T00:30:13.596ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4512024-11-14T00:30:13.596ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4522024-11-14T00:30:13.598ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4532024-11-14T00:30:13.599ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4542024-11-14T00:30:13.601ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4552024-11-14T00:30:13.601ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4562024-11-14T00:30:13.603ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4572024-11-14T00:30:13.603ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4582024-11-14T00:30:13.604ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4592024-11-14T00:30:13.607ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4602024-11-14T00:30:13.607ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4612024-11-14T00:30:13.607ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4622024-11-14T00:30:13.609ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4632024-11-14T00:30:13.609ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4642024-11-14T00:30:13.612ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4652024-11-14T00:30:13.612ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4662024-11-14T00:30:13.614ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4672024-11-14T00:30:13.615ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4682024-11-14T00:30:13.617ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4692024-11-14T00:30:13.619ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4702024-11-14T00:30:13.619ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4712024-11-14T00:30:13.620ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4722024-11-14T00:30:13.655ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91148 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 10d93d8b-2448-49d2-a355-18e47945a467 response_code = 200 uri = /v1/instances/instance-c9025c66cce/serial-console?from_start=0&max_bytes=10485760&project=proj-c66a78d0335
4732024-11-14T00:30:14.343ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4742024-11-14T00:30:14.343ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4752024-11-14T00:30:14.345ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4762024-11-14T00:30:14.345ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4772024-11-14T00:30:14.347ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4782024-11-14T00:30:14.348ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
4792024-11-14T00:30:14.348ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4802024-11-14T00:30:14.348ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4812024-11-14T00:30:14.350ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4822024-11-14T00:30:14.350ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4832024-11-14T00:30:14.352ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4842024-11-14T00:30:14.352ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4852024-11-14T00:30:14.353ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4862024-11-14T00:30:14.353ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4872024-11-14T00:30:14.355ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4882024-11-14T00:30:14.356ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
4892024-11-14T00:30:14.356ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4902024-11-14T00:30:14.357ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4912024-11-14T00:30:14.358ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4922024-11-14T00:30:14.359ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
4932024-11-14T00:30:14.359ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4942024-11-14T00:30:14.359ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4952024-11-14T00:30:14.366ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4962024-11-14T00:30:14.366ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4972024-11-14T00:30:14.368ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4982024-11-14T00:30:14.368ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4992024-11-14T00:30:14.369ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5002024-11-14T00:30:14.370ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5012024-11-14T00:30:14.371ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5022024-11-14T00:30:14.371ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5032024-11-14T00:30:14.372ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5042024-11-14T00:30:14.374ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
5052024-11-14T00:30:14.374ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5062024-11-14T00:30:14.374ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5072024-11-14T00:30:14.375ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5082024-11-14T00:30:14.375ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5092024-11-14T00:30:14.377ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5102024-11-14T00:30:14.377ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5112024-11-14T00:30:14.378ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5122024-11-14T00:30:14.379ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
5132024-11-14T00:30:14.379ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5142024-11-14T00:30:14.379ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5152024-11-14T00:30:14.380ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5162024-11-14T00:30:14.381ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5172024-11-14T00:30:14.382ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5182024-11-14T00:30:14.382ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5192024-11-14T00:30:14.384ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5202024-11-14T00:30:14.384ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5212024-11-14T00:30:14.386ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5222024-11-14T00:30:14.387ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5232024-11-14T00:30:14.388ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5242024-11-14T00:30:14.389ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5252024-11-14T00:30:14.391ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5262024-11-14T00:30:14.391ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5272024-11-14T00:30:14.393ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5282024-11-14T00:30:14.396ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5292024-11-14T00:30:14.396ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5302024-11-14T00:30:14.396ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5312024-11-14T00:30:14.399ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5322024-11-14T00:30:14.399ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5332024-11-14T00:30:14.401ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5342024-11-14T00:30:14.401ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5352024-11-14T00:30:14.403ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5362024-11-14T00:30:14.403ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5372024-11-14T00:30:14.405ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5382024-11-14T00:30:14.407ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5392024-11-14T00:30:14.407ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5402024-11-14T00:30:14.408ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5412024-11-14T00:30:14.410ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 66731 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = ca25b9a9-ab70-49bb-867c-c42fe9943ad2 response_code = 200 uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
5422024-11-14T00:30:14.411ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5432024-11-14T00:30:14.411ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5442024-11-14T00:30:14.413ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5452024-11-14T00:30:14.413ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5462024-11-14T00:30:14.415ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5472024-11-14T00:30:14.416ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
5482024-11-14T00:30:14.416ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5492024-11-14T00:30:14.416ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5502024-11-14T00:30:14.418ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5512024-11-14T00:30:14.418ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5522024-11-14T00:30:14.420ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5532024-11-14T00:30:14.420ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5542024-11-14T00:30:14.422ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5552024-11-14T00:30:14.422ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5562024-11-14T00:30:14.423ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5572024-11-14T00:30:14.424ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
5582024-11-14T00:30:14.424ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5592024-11-14T00:30:14.425ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5602024-11-14T00:30:14.426ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5612024-11-14T00:30:14.427ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
5622024-11-14T00:30:14.427ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5632024-11-14T00:30:14.427ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5642024-11-14T00:30:14.445ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5652024-11-14T00:30:14.445ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5662024-11-14T00:30:14.447ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5672024-11-14T00:30:14.447ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5682024-11-14T00:30:14.449ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5692024-11-14T00:30:14.449ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5702024-11-14T00:30:14.450ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5712024-11-14T00:30:14.450ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5722024-11-14T00:30:14.452ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5732024-11-14T00:30:14.453ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
5742024-11-14T00:30:14.453ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5752024-11-14T00:30:14.453ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5762024-11-14T00:30:14.454ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5772024-11-14T00:30:14.454ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5782024-11-14T00:30:14.456ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
5792024-11-14T00:30:14.456ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
5802024-11-14T00:30:14.457ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
5812024-11-14T00:30:14.458ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
5822024-11-14T00:30:14.458ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5832024-11-14T00:30:14.458ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5842024-11-14T00:30:14.460ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5852024-11-14T00:30:14.460ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5862024-11-14T00:30:14.461ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5872024-11-14T00:30:14.462ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5882024-11-14T00:30:14.464ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5892024-11-14T00:30:14.464ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5902024-11-14T00:30:14.466ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5912024-11-14T00:30:14.467ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5922024-11-14T00:30:14.469ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5932024-11-14T00:30:14.469ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5942024-11-14T00:30:14.471ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5952024-11-14T00:30:14.471ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5962024-11-14T00:30:14.474ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5972024-11-14T00:30:14.476ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5982024-11-14T00:30:14.476ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
5992024-11-14T00:30:14.476ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
6002024-11-14T00:30:14.478ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
6012024-11-14T00:30:14.478ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
6022024-11-14T00:30:14.480ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
6032024-11-14T00:30:14.480ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
6042024-11-14T00:30:14.482ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
6052024-11-14T00:30:14.483ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
6062024-11-14T00:30:14.485ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
6072024-11-14T00:30:14.487ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
6082024-11-14T00:30:14.488ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
6092024-11-14T00:30:14.488ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
6102024-11-14T00:30:14.526ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 115168 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:33930 req_id = 1e4f8bcf-aef5-4a41-949c-038c1f67cb79 response_code = 200 uri = /v1/instances/instance-c9025c66cce/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-c66a78d0335
6112024-11-14T00:30:15.025ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6122024-11-14T00:30:15.026ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6132024-11-14T00:30:15.027ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6142024-11-14T00:30:15.028ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6152024-11-14T00:30:15.029ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6162024-11-14T00:30:15.031ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
6172024-11-14T00:30:15.031ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6182024-11-14T00:30:15.031ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6192024-11-14T00:30:15.033ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6202024-11-14T00:30:15.033ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6212024-11-14T00:30:15.034ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6222024-11-14T00:30:15.034ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6232024-11-14T00:30:15.036ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6242024-11-14T00:30:15.036ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6252024-11-14T00:30:15.037ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6262024-11-14T00:30:15.039ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
6272024-11-14T00:30:15.039ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6282024-11-14T00:30:15.039ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6292024-11-14T00:30:15.040ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6302024-11-14T00:30:15.041ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
6312024-11-14T00:30:15.041ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6322024-11-14T00:30:15.042ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6332024-11-14T00:30:15.050ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6342024-11-14T00:30:15.050ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6352024-11-14T00:30:15.051ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6362024-11-14T00:30:15.051ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6372024-11-14T00:30:15.053ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6382024-11-14T00:30:15.053ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6392024-11-14T00:30:15.054ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6402024-11-14T00:30:15.054ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6412024-11-14T00:30:15.055ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6422024-11-14T00:30:15.056ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
6432024-11-14T00:30:15.056ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6442024-11-14T00:30:15.057ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6452024-11-14T00:30:15.058ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6462024-11-14T00:30:15.058ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6472024-11-14T00:30:15.059ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6482024-11-14T00:30:15.059ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6492024-11-14T00:30:15.061ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6502024-11-14T00:30:15.062ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
6512024-11-14T00:30:15.062ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6522024-11-14T00:30:15.062ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6532024-11-14T00:30:15.063ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6542024-11-14T00:30:15.063ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6552024-11-14T00:30:15.065ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6562024-11-14T00:30:15.065ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6572024-11-14T00:30:15.068ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6582024-11-14T00:30:15.068ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6592024-11-14T00:30:15.070ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6602024-11-14T00:30:15.070ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6612024-11-14T00:30:15.072ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6622024-11-14T00:30:15.072ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6632024-11-14T00:30:15.074ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6642024-11-14T00:30:15.074ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6652024-11-14T00:30:15.076ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6662024-11-14T00:30:15.079ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6672024-11-14T00:30:15.079ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6682024-11-14T00:30:15.079ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6692024-11-14T00:30:15.082ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6702024-11-14T00:30:15.082ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6712024-11-14T00:30:15.084ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6722024-11-14T00:30:15.084ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6732024-11-14T00:30:15.086ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6742024-11-14T00:30:15.086ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6752024-11-14T00:30:15.088ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6762024-11-14T00:30:15.090ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6772024-11-14T00:30:15.090ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6782024-11-14T00:30:15.090ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6792024-11-14T00:30:15.094ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
6802024-11-14T00:30:15.094ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
6812024-11-14T00:30:15.096ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
6822024-11-14T00:30:15.096ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
6832024-11-14T00:30:15.097ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
6842024-11-14T00:30:15.099ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: e211d163-be78-4663-b73f-baf5e9462a10, lookup_type: ById(e211d163-be78-4663-b73f-baf5e9462a10) } result = Ok(())
6852024-11-14T00:30:15.129ZDEBGnexus: client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vmms/74827a84-0484-483d-b883-f1f6670c5693/state
6862024-11-14T00:30:15.130ZDEBGnexus: client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/74827a84-0484-483d-b883-f1f6670c5693/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e82b03c-7eb0-4a6c-994c-2ab5ae9cf29d", "content-length": "151", "date": "Thu, 14 Nov 2024 00:30:15 GMT"} })
6872024-11-14T00:30:15.130ZINFOnexus (dropshot_external): received new VMM runtime state from sled agent actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = 172.30.2.5:443 method = POST migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 74827a84-0484-483d-b883-f1f6670c5693 remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-11-14T00:30:15.130284253Z }
6882024-11-14T00:30:15.130ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6892024-11-14T00:30:15.130ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6902024-11-14T00:30:15.170ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6912024-11-14T00:30:15.170ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6922024-11-14T00:30:15.172ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6932024-11-14T00:30:15.172ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6942024-11-14T00:30:15.175ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6952024-11-14T00:30:15.175ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6962024-11-14T00:30:15.178ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6972024-11-14T00:30:15.178ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6982024-11-14T00:30:15.181ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
6992024-11-14T00:30:15.184ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
7002024-11-14T00:30:15.184ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
7012024-11-14T00:30:15.184ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
7022024-11-14T00:30:15.186ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 160639 local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:33930 req_id = e1667624-20ea-4f9e-929d-6f41cb982434 response_code = 202 uri = /v1/instances/instance-c9025c66cce/stop?project=proj-c66a78d0335
7032024-11-14T00:30:15.187ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7042024-11-14T00:30:15.187ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7052024-11-14T00:30:15.189ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7062024-11-14T00:30:15.189ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7072024-11-14T00:30:15.190ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7082024-11-14T00:30:15.191ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
7092024-11-14T00:30:15.191ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7102024-11-14T00:30:15.192ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7112024-11-14T00:30:15.193ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7122024-11-14T00:30:15.193ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7132024-11-14T00:30:15.195ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7142024-11-14T00:30:15.195ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7152024-11-14T00:30:15.196ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7162024-11-14T00:30:15.196ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7172024-11-14T00:30:15.197ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7182024-11-14T00:30:15.198ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
7192024-11-14T00:30:15.198ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7202024-11-14T00:30:15.199ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7212024-11-14T00:30:15.200ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7222024-11-14T00:30:15.201ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
7232024-11-14T00:30:15.201ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7242024-11-14T00:30:15.201ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7252024-11-14T00:30:15.206ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7262024-11-14T00:30:15.206ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7272024-11-14T00:30:15.207ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7282024-11-14T00:30:15.208ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7292024-11-14T00:30:15.209ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7302024-11-14T00:30:15.209ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7312024-11-14T00:30:15.210ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7322024-11-14T00:30:15.210ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7332024-11-14T00:30:15.212ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7342024-11-14T00:30:15.213ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
7352024-11-14T00:30:15.213ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7362024-11-14T00:30:15.213ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7372024-11-14T00:30:15.214ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7382024-11-14T00:30:15.214ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7392024-11-14T00:30:15.215ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7402024-11-14T00:30:15.216ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7412024-11-14T00:30:15.217ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7422024-11-14T00:30:15.218ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
7432024-11-14T00:30:15.218ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7442024-11-14T00:30:15.218ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7452024-11-14T00:30:15.219ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7462024-11-14T00:30:15.219ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7472024-11-14T00:30:15.221ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7482024-11-14T00:30:15.221ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7492024-11-14T00:30:15.223ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7502024-11-14T00:30:15.223ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7512024-11-14T00:30:15.225ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7522024-11-14T00:30:15.225ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7532024-11-14T00:30:15.228ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7542024-11-14T00:30:15.228ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7552024-11-14T00:30:15.230ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7562024-11-14T00:30:15.230ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7572024-11-14T00:30:15.232ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7582024-11-14T00:30:15.235ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
7592024-11-14T00:30:15.235ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
7602024-11-14T00:30:15.235ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
7612024-11-14T00:30:15.236ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
7622024-11-14T00:30:15.237ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
7632024-11-14T00:30:15.237ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
7642024-11-14T00:30:15.237ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
7652024-11-14T00:30:15.240ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete
7662024-11-14T00:30:15.240ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"e21ef448-9c04-42c3-96f9-7b85864c1212","lookup_type":{"ByName":"instance-c9025c66cce"},"parent":{"key":"17b1ded6-f8f1-45cb-8443-dafcf0963e1d","lookup_type":{"ByName":"proj-c66a78d0335"},"parent":{"key":"bf9014ac-edb7-4293-a1ff-4004060e0581","lookup_type":{"ById":"bf9014ac-edb7-4293-a1ff-4004060e0581"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"64ab900b-4058-4c6e-9b6e-5704580f39a6","hostname":"localshark","identity":{"description":"","id":"e21ef448-9c04-42c3-96f9-7b85864c1212","name":"instance-c9025c66cce","time_created":"2024-11-14T00:29:54.960059Z","time_deleted":null,"time_modified":"2024-11-14T00:29:54.960059Z"},"memory":1073741824,"ncpus":2,"project_id":"17b1ded6-f8f1-45cb-8443-dafcf0963e1d","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"74827a84-0484-483d-b883-f1f6670c5693","time_last_auto_restarted":null,"time_updated":"2024-11-14T00:29:54.960059Z"},"updater_gen":1,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"bf9014ac-edb7-4293-a1ff-4004060e0581","silo_user_id":"2a6d5982-5d0f-4844-9dca-f3d9f0d527e6"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
7672024-11-14T00:30:15.240ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete
7682024-11-14T00:30:15.246ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete
7692024-11-14T00:30:15.246ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
7702024-11-14T00:30:15.246ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
7712024-11-14T00:30:15.246ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b
7722024-11-14T00:30:15.250ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
7732024-11-14T00:30:15.250ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b
7742024-11-14T00:30:15.253ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
7752024-11-14T00:30:15.253ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b
7762024-11-14T00:30:15.257ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7772024-11-14T00:30:15.257ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7782024-11-14T00:30:15.258ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7792024-11-14T00:30:15.258ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7802024-11-14T00:30:15.259ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7812024-11-14T00:30:15.259ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7822024-11-14T00:30:15.261ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7832024-11-14T00:30:15.261ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7842024-11-14T00:30:15.263ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7852024-11-14T00:30:15.263ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7862024-11-14T00:30:15.266ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7872024-11-14T00:30:15.266ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7882024-11-14T00:30:15.268ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7892024-11-14T00:30:15.268ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7902024-11-14T00:30:15.270ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7912024-11-14T00:30:15.273ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ById(17b1ded6-f8f1-45cb-8443-dafcf0963e1d) }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ById(e21ef448-9c04-42c3-96f9-7b85864c1212) } result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7922024-11-14T00:30:15.273ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212
7932024-11-14T00:30:15.273ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7942024-11-14T00:30:15.273ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7952024-11-14T00:30:15.275ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7962024-11-14T00:30:15.275ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7972024-11-14T00:30:15.285ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7982024-11-14T00:30:15.285ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteNat
7992024-11-14T00:30:15.292ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
8002024-11-14T00:30:15.292ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
8012024-11-14T00:30:15.294ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
8022024-11-14T00:30:15.295ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
8032024-11-14T00:30:15.295ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
8042024-11-14T00:30:15.295ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
8052024-11-14T00:30:15.299ZDEBGnexus: notifying dendrite of updates instance_id = Some(e21ef448-9c04-42c3-96f9-7b85864c1212 (instance)) switch = switch0
8062024-11-14T00:30:15.299ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1715, tv_nsec: 16516567 } })
8072024-11-14T00:30:15.299ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
8082024-11-14T00:30:15.331ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
8092024-11-14T00:30:15.331ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8102024-11-14T00:30:15.331ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bc7d618-5bc3-4064-8771-99e70e177b33", "content-length": "26", "date": "Thu, 14 Nov 2024 00:30:15 GMT"} })
8112024-11-14T00:30:15.331ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8122024-11-14T00:30:15.332ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8132024-11-14T00:30:15.362ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
8142024-11-14T00:30:15.362ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "13aa4a71-58bc-4ad1-9089-f9042f804cfe", "content-length": "4", "date": "Thu, 14 Nov 2024 00:30:14 GMT"} })
8152024-11-14T00:30:15.363ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
8162024-11-14T00:30:15.363ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b
8172024-11-14T00:30:15.368ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
8182024-11-14T00:30:15.368ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b
8192024-11-14T00:30:15.372ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteRecord
8202024-11-14T00:30:15.372ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteRecord
8212024-11-14T00:30:15.375ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteRecord
8222024-11-14T00:30:15.375ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteRecord
8232024-11-14T00:30:15.378ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteRecord
8242024-11-14T00:30:15.378ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteRecord
8252024-11-14T00:30:15.381ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteRecord
8262024-11-14T00:30:15.381ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteRecord
8272024-11-14T00:30:15.383ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteRecord
8282024-11-14T00:30:15.386ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteRecord
8292024-11-14T00:30:15.386ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteRecord
8302024-11-14T00:30:15.386ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_node = InstanceDeleteRecord
8312024-11-14T00:30:15.397ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
8322024-11-14T00:30:15.398ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b
8332024-11-14T00:30:15.401ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
8342024-11-14T00:30:15.401ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = unwinding saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b
8352024-11-14T00:30:15.408ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
8362024-11-14T00:30:15.408ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b
8372024-11-14T00:30:15.410ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
8382024-11-14T00:30:15.411ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b
8392024-11-14T00:30:15.414ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
8402024-11-14T00:30:15.414ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b
8412024-11-14T00:30:15.418ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
8422024-11-14T00:30:15.418ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b
8432024-11-14T00:30:15.421ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
8442024-11-14T00:30:15.421ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b
8452024-11-14T00:30:15.428ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13 undo_result = success
8462024-11-14T00:30:15.428ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b saga_name = instance-delete saga_result = SagaResult { saga_id: 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b, saga_log: SagaLog { saga_id: 91c3891b-7dd6-4711-a5e8-d01ccc8ec00b, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
8472024-11-14T00:30:15.428ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 240788 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = b70c9ddc-b50b-4128-92d4-43f9d1c49410 response_code = 400 uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
8482024-11-14T00:30:15.948ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2473 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = 1cceb9fe-f7b8-4bbb-9c6e-f06fff201e6e response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
8492024-11-14T00:30:16.430ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8502024-11-14T00:30:16.431ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8512024-11-14T00:30:16.432ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8522024-11-14T00:30:16.433ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8532024-11-14T00:30:16.434ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8542024-11-14T00:30:16.435ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
8552024-11-14T00:30:16.435ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8562024-11-14T00:30:16.435ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8572024-11-14T00:30:16.437ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8582024-11-14T00:30:16.437ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8592024-11-14T00:30:16.439ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8602024-11-14T00:30:16.439ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8612024-11-14T00:30:16.441ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8622024-11-14T00:30:16.441ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8632024-11-14T00:30:16.443ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8642024-11-14T00:30:16.444ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
8652024-11-14T00:30:16.444ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8662024-11-14T00:30:16.444ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8672024-11-14T00:30:16.445ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8682024-11-14T00:30:16.446ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
8692024-11-14T00:30:16.446ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8702024-11-14T00:30:16.447ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8712024-11-14T00:30:16.450ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8722024-11-14T00:30:16.450ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8732024-11-14T00:30:16.452ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8742024-11-14T00:30:16.452ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8752024-11-14T00:30:16.453ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8762024-11-14T00:30:16.453ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8772024-11-14T00:30:16.455ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8782024-11-14T00:30:16.455ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8792024-11-14T00:30:16.456ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8802024-11-14T00:30:16.457ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
8812024-11-14T00:30:16.457ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8822024-11-14T00:30:16.457ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8832024-11-14T00:30:16.459ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8842024-11-14T00:30:16.459ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8852024-11-14T00:30:16.460ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8862024-11-14T00:30:16.460ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8872024-11-14T00:30:16.461ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8882024-11-14T00:30:16.462ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
8892024-11-14T00:30:16.463ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
8902024-11-14T00:30:16.463ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
8912024-11-14T00:30:16.464ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
8922024-11-14T00:30:16.464ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
8932024-11-14T00:30:16.466ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
8942024-11-14T00:30:16.466ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
8952024-11-14T00:30:16.468ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
8962024-11-14T00:30:16.468ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
8972024-11-14T00:30:16.470ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
8982024-11-14T00:30:16.470ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
8992024-11-14T00:30:16.472ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
9002024-11-14T00:30:16.472ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
9012024-11-14T00:30:16.475ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
9022024-11-14T00:30:16.475ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
9032024-11-14T00:30:16.476ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
9042024-11-14T00:30:16.479ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
9052024-11-14T00:30:16.479ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
9062024-11-14T00:30:16.479ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
9072024-11-14T00:30:16.480ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
9082024-11-14T00:30:16.481ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
9092024-11-14T00:30:16.481ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
9102024-11-14T00:30:16.481ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
9112024-11-14T00:30:16.486ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete
9122024-11-14T00:30:16.486ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"e21ef448-9c04-42c3-96f9-7b85864c1212","lookup_type":{"ByName":"instance-c9025c66cce"},"parent":{"key":"17b1ded6-f8f1-45cb-8443-dafcf0963e1d","lookup_type":{"ByName":"proj-c66a78d0335"},"parent":{"key":"bf9014ac-edb7-4293-a1ff-4004060e0581","lookup_type":{"ById":"bf9014ac-edb7-4293-a1ff-4004060e0581"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"64ab900b-4058-4c6e-9b6e-5704580f39a6","hostname":"localshark","identity":{"description":"","id":"e21ef448-9c04-42c3-96f9-7b85864c1212","name":"instance-c9025c66cce","time_created":"2024-11-14T00:29:54.960059Z","time_deleted":null,"time_modified":"2024-11-14T00:29:54.960059Z"},"memory":1073741824,"ncpus":2,"project_id":"17b1ded6-f8f1-45cb-8443-dafcf0963e1d","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"74827a84-0484-483d-b883-f1f6670c5693","time_last_auto_restarted":null,"time_updated":"2024-11-14T00:29:54.960059Z"},"updater_gen":1,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"bf9014ac-edb7-4293-a1ff-4004060e0581","silo_user_id":"2a6d5982-5d0f-4844-9dca-f3d9f0d527e6"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
9132024-11-14T00:30:16.486ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete
9142024-11-14T00:30:16.490ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete
9152024-11-14T00:30:16.490ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
9162024-11-14T00:30:16.490ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
9172024-11-14T00:30:16.490ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5
9182024-11-14T00:30:16.494ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
9192024-11-14T00:30:16.494ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5
9202024-11-14T00:30:16.497ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
9212024-11-14T00:30:16.497ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5
9222024-11-14T00:30:16.500ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9232024-11-14T00:30:16.501ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9242024-11-14T00:30:16.502ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9252024-11-14T00:30:16.502ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9262024-11-14T00:30:16.504ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9272024-11-14T00:30:16.504ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9282024-11-14T00:30:16.505ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9292024-11-14T00:30:16.505ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9302024-11-14T00:30:16.507ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9312024-11-14T00:30:16.507ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9322024-11-14T00:30:16.509ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9332024-11-14T00:30:16.509ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9342024-11-14T00:30:16.511ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9352024-11-14T00:30:16.512ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9362024-11-14T00:30:16.514ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9372024-11-14T00:30:16.516ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ById(17b1ded6-f8f1-45cb-8443-dafcf0963e1d) }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ById(e21ef448-9c04-42c3-96f9-7b85864c1212) } result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9382024-11-14T00:30:16.516ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212
9392024-11-14T00:30:16.516ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9402024-11-14T00:30:16.516ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9412024-11-14T00:30:16.520ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9422024-11-14T00:30:16.520ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9432024-11-14T00:30:16.522ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
9442024-11-14T00:30:16.522ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9452024-11-14T00:30:16.522ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteNat
9462024-11-14T00:30:16.524ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
9472024-11-14T00:30:16.524ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
9482024-11-14T00:30:16.524ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
9492024-11-14T00:30:16.526ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
9502024-11-14T00:30:16.527ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
9512024-11-14T00:30:16.527ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
9522024-11-14T00:30:16.527ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
9532024-11-14T00:30:16.530ZDEBGnexus: notifying dendrite of updates instance_id = Some(e21ef448-9c04-42c3-96f9-7b85864c1212 (instance)) switch = switch0
9542024-11-14T00:30:16.530ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1716, tv_nsec: 247618801 } })
9552024-11-14T00:30:16.530ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
9562024-11-14T00:30:16.560ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
9572024-11-14T00:30:16.560ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9582024-11-14T00:30:16.561ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "02689462-c1f4-49dd-bb29-a3a9b9f30ec2", "content-length": "26", "date": "Thu, 14 Nov 2024 00:30:16 GMT"} })
9592024-11-14T00:30:16.561ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9602024-11-14T00:30:16.561ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
9612024-11-14T00:30:16.590ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
9622024-11-14T00:30:16.590ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c87a873-fb5d-4bf6-bf0d-0401d93a3bdc", "content-length": "4", "date": "Thu, 14 Nov 2024 00:30:15 GMT"} })
9632024-11-14T00:30:16.591ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
9642024-11-14T00:30:16.591ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5
9652024-11-14T00:30:16.594ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
9662024-11-14T00:30:16.594ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5
9672024-11-14T00:30:16.598ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteRecord
9682024-11-14T00:30:16.598ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteRecord
9692024-11-14T00:30:16.600ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteRecord
9702024-11-14T00:30:16.600ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteRecord
9712024-11-14T00:30:16.602ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteRecord
9722024-11-14T00:30:16.603ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteRecord
9732024-11-14T00:30:16.605ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteRecord
9742024-11-14T00:30:16.605ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteRecord
9752024-11-14T00:30:16.607ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteRecord
9762024-11-14T00:30:16.610ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteRecord
9772024-11-14T00:30:16.610ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteRecord
9782024-11-14T00:30:16.610ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_node = InstanceDeleteRecord
9792024-11-14T00:30:16.692ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
9802024-11-14T00:30:16.692ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5
9812024-11-14T00:30:16.697ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
9822024-11-14T00:30:16.697ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = unwinding saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5
9832024-11-14T00:30:16.710ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
9842024-11-14T00:30:16.710ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5
9852024-11-14T00:30:16.715ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
9862024-11-14T00:30:16.715ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5
9872024-11-14T00:30:16.720ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
9882024-11-14T00:30:16.720ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5
9892024-11-14T00:30:16.724ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
9902024-11-14T00:30:16.724ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5
9912024-11-14T00:30:16.729ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
9922024-11-14T00:30:16.729ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5
9932024-11-14T00:30:16.737ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13 undo_result = success
9942024-11-14T00:30:16.737ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = fbc84edf-120d-4d21-8545-68f51c4444b5 saga_name = instance-delete saga_result = SagaResult { saga_id: fbc84edf-120d-4d21-8545-68f51c4444b5, saga_log: SagaLog { saga_id: fbc84edf-120d-4d21-8545-68f51c4444b5, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
9952024-11-14T00:30:16.737ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 306537 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 58f75c3f-d417-450a-b951-9ef299846d48 response_code = 400 uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
9962024-11-14T00:30:17.739ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9972024-11-14T00:30:17.740ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9982024-11-14T00:30:17.741ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9992024-11-14T00:30:17.741ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10002024-11-14T00:30:17.743ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10012024-11-14T00:30:17.744ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
10022024-11-14T00:30:17.744ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10032024-11-14T00:30:17.744ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10042024-11-14T00:30:17.745ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10052024-11-14T00:30:17.745ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10062024-11-14T00:30:17.747ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10072024-11-14T00:30:17.747ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10082024-11-14T00:30:17.748ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10092024-11-14T00:30:17.749ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10102024-11-14T00:30:17.750ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10112024-11-14T00:30:17.751ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
10122024-11-14T00:30:17.751ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10132024-11-14T00:30:17.751ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10142024-11-14T00:30:17.753ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10152024-11-14T00:30:17.754ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
10162024-11-14T00:30:17.754ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10172024-11-14T00:30:17.754ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10182024-11-14T00:30:17.762ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10192024-11-14T00:30:17.762ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10202024-11-14T00:30:17.763ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10212024-11-14T00:30:17.763ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10222024-11-14T00:30:17.768ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10232024-11-14T00:30:17.768ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10242024-11-14T00:30:17.770ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10252024-11-14T00:30:17.770ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10262024-11-14T00:30:17.772ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10272024-11-14T00:30:17.773ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
10282024-11-14T00:30:17.773ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10292024-11-14T00:30:17.773ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10302024-11-14T00:30:17.774ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10312024-11-14T00:30:17.775ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10322024-11-14T00:30:17.776ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10332024-11-14T00:30:17.776ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10342024-11-14T00:30:17.777ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10352024-11-14T00:30:17.779ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
10362024-11-14T00:30:17.779ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10372024-11-14T00:30:17.779ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10382024-11-14T00:30:17.780ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10392024-11-14T00:30:17.780ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10402024-11-14T00:30:17.781ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10412024-11-14T00:30:17.781ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10422024-11-14T00:30:17.783ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10432024-11-14T00:30:17.783ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10442024-11-14T00:30:17.786ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10452024-11-14T00:30:17.786ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10462024-11-14T00:30:17.789ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10472024-11-14T00:30:17.789ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10482024-11-14T00:30:17.792ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10492024-11-14T00:30:17.792ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10502024-11-14T00:30:17.794ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10512024-11-14T00:30:17.797ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
10522024-11-14T00:30:17.797ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
10532024-11-14T00:30:17.797ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
10542024-11-14T00:30:17.798ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
10552024-11-14T00:30:17.799ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
10562024-11-14T00:30:17.799ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
10572024-11-14T00:30:17.799ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
10582024-11-14T00:30:17.805ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete
10592024-11-14T00:30:17.805ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"e21ef448-9c04-42c3-96f9-7b85864c1212","lookup_type":{"ByName":"instance-c9025c66cce"},"parent":{"key":"17b1ded6-f8f1-45cb-8443-dafcf0963e1d","lookup_type":{"ByName":"proj-c66a78d0335"},"parent":{"key":"bf9014ac-edb7-4293-a1ff-4004060e0581","lookup_type":{"ById":"bf9014ac-edb7-4293-a1ff-4004060e0581"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"64ab900b-4058-4c6e-9b6e-5704580f39a6","hostname":"localshark","identity":{"description":"","id":"e21ef448-9c04-42c3-96f9-7b85864c1212","name":"instance-c9025c66cce","time_created":"2024-11-14T00:29:54.960059Z","time_deleted":null,"time_modified":"2024-11-14T00:29:54.960059Z"},"memory":1073741824,"ncpus":2,"project_id":"17b1ded6-f8f1-45cb-8443-dafcf0963e1d","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"74827a84-0484-483d-b883-f1f6670c5693","time_last_auto_restarted":null,"time_updated":"2024-11-14T00:29:54.960059Z"},"updater_gen":2,"updater_id":"0236d474-7b87-46b6-874a-465ab3af99e5","user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"bf9014ac-edb7-4293-a1ff-4004060e0581","silo_user_id":"2a6d5982-5d0f-4844-9dca-f3d9f0d527e6"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
10602024-11-14T00:30:17.805ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete
10612024-11-14T00:30:17.808ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete
10622024-11-14T00:30:17.808ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
10632024-11-14T00:30:17.808ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
10642024-11-14T00:30:17.808ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434
10652024-11-14T00:30:17.812ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
10662024-11-14T00:30:17.812ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434
10672024-11-14T00:30:17.815ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
10682024-11-14T00:30:17.815ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434
10692024-11-14T00:30:17.820ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10702024-11-14T00:30:17.820ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10712024-11-14T00:30:17.822ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10722024-11-14T00:30:17.822ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10732024-11-14T00:30:17.825ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10742024-11-14T00:30:17.825ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10752024-11-14T00:30:17.828ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10762024-11-14T00:30:17.829ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10772024-11-14T00:30:17.831ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10782024-11-14T00:30:17.831ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10792024-11-14T00:30:17.833ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10802024-11-14T00:30:17.833ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10812024-11-14T00:30:17.836ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10822024-11-14T00:30:17.836ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10832024-11-14T00:30:17.838ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10842024-11-14T00:30:17.841ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ById(17b1ded6-f8f1-45cb-8443-dafcf0963e1d) }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ById(e21ef448-9c04-42c3-96f9-7b85864c1212) } result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10852024-11-14T00:30:17.841ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212
10862024-11-14T00:30:17.841ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10872024-11-14T00:30:17.841ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10882024-11-14T00:30:17.842ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10892024-11-14T00:30:17.842ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10902024-11-14T00:30:17.844ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
10912024-11-14T00:30:17.844ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10922024-11-14T00:30:17.845ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteNat
10932024-11-14T00:30:17.847ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
10942024-11-14T00:30:17.847ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
10952024-11-14T00:30:17.847ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
10962024-11-14T00:30:17.848ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
10972024-11-14T00:30:17.849ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
10982024-11-14T00:30:17.849ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
10992024-11-14T00:30:17.850ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
11002024-11-14T00:30:17.854ZDEBGnexus: notifying dendrite of updates instance_id = Some(e21ef448-9c04-42c3-96f9-7b85864c1212 (instance)) switch = switch0
11012024-11-14T00:30:17.854ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1717, tv_nsec: 571487051 } })
11022024-11-14T00:30:17.854ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
11032024-11-14T00:30:17.885ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
11042024-11-14T00:30:17.885ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11052024-11-14T00:30:17.886ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fac0964-8867-42ee-a1c7-e4338acba4e1", "content-length": "26", "date": "Thu, 14 Nov 2024 00:30:17 GMT"} })
11062024-11-14T00:30:17.886ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11072024-11-14T00:30:17.886ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11082024-11-14T00:30:17.916ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
11092024-11-14T00:30:17.916ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "d875bc7b-171f-4e81-8ae4-cf9acbe0d32f", "content-length": "4", "date": "Thu, 14 Nov 2024 00:30:16 GMT"} })
11102024-11-14T00:30:17.918ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
11112024-11-14T00:30:17.918ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434
11122024-11-14T00:30:17.922ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
11132024-11-14T00:30:17.922ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434
11142024-11-14T00:30:17.925ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteRecord
11152024-11-14T00:30:17.925ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteRecord
11162024-11-14T00:30:17.927ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteRecord
11172024-11-14T00:30:17.927ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteRecord
11182024-11-14T00:30:17.930ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteRecord
11192024-11-14T00:30:17.930ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteRecord
11202024-11-14T00:30:17.932ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteRecord
11212024-11-14T00:30:17.933ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteRecord
11222024-11-14T00:30:17.935ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteRecord
11232024-11-14T00:30:17.938ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteRecord
11242024-11-14T00:30:17.938ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteRecord
11252024-11-14T00:30:17.938ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_node = InstanceDeleteRecord
11262024-11-14T00:30:18.009ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
11272024-11-14T00:30:18.009ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434
11282024-11-14T00:30:18.013ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
11292024-11-14T00:30:18.013ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = unwinding saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434
11302024-11-14T00:30:18.021ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
11312024-11-14T00:30:18.021ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434
11322024-11-14T00:30:18.026ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
11332024-11-14T00:30:18.026ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434
11342024-11-14T00:30:18.029ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
11352024-11-14T00:30:18.029ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434
11362024-11-14T00:30:18.032ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
11372024-11-14T00:30:18.032ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434
11382024-11-14T00:30:18.035ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
11392024-11-14T00:30:18.035ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434
11402024-11-14T00:30:18.041ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13 undo_result = success
11412024-11-14T00:30:18.041ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 9d7c73ae-83d4-4420-8fee-5f990250e434 saga_name = instance-delete saga_result = SagaResult { saga_id: 9d7c73ae-83d4-4420-8fee-5f990250e434, saga_log: SagaLog { saga_id: 9d7c73ae-83d4-4420-8fee-5f990250e434, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
11422024-11-14T00:30:18.041ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 301390 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = ccf6d7cd-8c30-4c7b-8c1f-abaa3efce66c response_code = 400 uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11432024-11-14T00:30:19.043ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11442024-11-14T00:30:19.043ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11452024-11-14T00:30:19.045ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11462024-11-14T00:30:19.045ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11472024-11-14T00:30:19.047ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11482024-11-14T00:30:19.048ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
11492024-11-14T00:30:19.048ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11502024-11-14T00:30:19.048ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11512024-11-14T00:30:19.050ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11522024-11-14T00:30:19.050ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11532024-11-14T00:30:19.052ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11542024-11-14T00:30:19.052ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11552024-11-14T00:30:19.054ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11562024-11-14T00:30:19.054ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11572024-11-14T00:30:19.055ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11582024-11-14T00:30:19.056ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
11592024-11-14T00:30:19.056ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11602024-11-14T00:30:19.057ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11612024-11-14T00:30:19.058ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11622024-11-14T00:30:19.059ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
11632024-11-14T00:30:19.059ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11642024-11-14T00:30:19.059ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11652024-11-14T00:30:19.065ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11662024-11-14T00:30:19.066ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11672024-11-14T00:30:19.067ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11682024-11-14T00:30:19.067ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11692024-11-14T00:30:19.069ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11702024-11-14T00:30:19.069ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11712024-11-14T00:30:19.070ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11722024-11-14T00:30:19.070ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11732024-11-14T00:30:19.071ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11742024-11-14T00:30:19.072ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
11752024-11-14T00:30:19.072ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11762024-11-14T00:30:19.073ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11772024-11-14T00:30:19.074ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11782024-11-14T00:30:19.074ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11792024-11-14T00:30:19.075ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11802024-11-14T00:30:19.075ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11812024-11-14T00:30:19.077ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11822024-11-14T00:30:19.078ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
11832024-11-14T00:30:19.078ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11842024-11-14T00:30:19.078ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11852024-11-14T00:30:19.080ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11862024-11-14T00:30:19.080ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11872024-11-14T00:30:19.081ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11882024-11-14T00:30:19.082ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11892024-11-14T00:30:19.083ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11902024-11-14T00:30:19.083ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11912024-11-14T00:30:19.085ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11922024-11-14T00:30:19.085ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11932024-11-14T00:30:19.088ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11942024-11-14T00:30:19.088ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11952024-11-14T00:30:19.090ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 roles = RoleSet { roles: {} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11962024-11-14T00:30:19.090ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 resource = Database result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11972024-11-14T00:30:19.092ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11982024-11-14T00:30:19.095ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
11992024-11-14T00:30:19.095ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12002024-11-14T00:30:19.095ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12012024-11-14T00:30:19.096ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
12022024-11-14T00:30:19.097ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
12032024-11-14T00:30:19.097ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12042024-11-14T00:30:19.097ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12052024-11-14T00:30:19.102ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete
12062024-11-14T00:30:19.102ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"e21ef448-9c04-42c3-96f9-7b85864c1212","lookup_type":{"ByName":"instance-c9025c66cce"},"parent":{"key":"17b1ded6-f8f1-45cb-8443-dafcf0963e1d","lookup_type":{"ByName":"proj-c66a78d0335"},"parent":{"key":"bf9014ac-edb7-4293-a1ff-4004060e0581","lookup_type":{"ById":"bf9014ac-edb7-4293-a1ff-4004060e0581"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"64ab900b-4058-4c6e-9b6e-5704580f39a6","hostname":"localshark","identity":{"description":"","id":"e21ef448-9c04-42c3-96f9-7b85864c1212","name":"instance-c9025c66cce","time_created":"2024-11-14T00:29:54.960059Z","time_deleted":null,"time_modified":"2024-11-14T00:29:54.960059Z"},"memory":1073741824,"ncpus":2,"project_id":"17b1ded6-f8f1-45cb-8443-dafcf0963e1d","runtime_state":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-14T00:30:17.807639Z"},"updater_gen":4,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"bf9014ac-edb7-4293-a1ff-4004060e0581","silo_user_id":"2a6d5982-5d0f-4844-9dca-f3d9f0d527e6"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
12072024-11-14T00:30:19.102ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete
12082024-11-14T00:30:19.108ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete
12092024-11-14T00:30:19.108ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
12102024-11-14T00:30:19.108ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
12112024-11-14T00:30:19.108ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150
12122024-11-14T00:30:19.114ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
12132024-11-14T00:30:19.114ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150
12142024-11-14T00:30:19.118ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
12152024-11-14T00:30:19.118ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150
12162024-11-14T00:30:19.122ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12172024-11-14T00:30:19.122ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12182024-11-14T00:30:19.124ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12192024-11-14T00:30:19.124ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12202024-11-14T00:30:19.125ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12212024-11-14T00:30:19.125ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12222024-11-14T00:30:19.126ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12232024-11-14T00:30:19.126ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12242024-11-14T00:30:19.129ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12252024-11-14T00:30:19.129ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12262024-11-14T00:30:19.131ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12272024-11-14T00:30:19.131ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12282024-11-14T00:30:19.133ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12292024-11-14T00:30:19.133ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12302024-11-14T00:30:19.135ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12312024-11-14T00:30:19.138ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ById(17b1ded6-f8f1-45cb-8443-dafcf0963e1d) }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ById(e21ef448-9c04-42c3-96f9-7b85864c1212) } result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12322024-11-14T00:30:19.138ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = e21ef448-9c04-42c3-96f9-7b85864c1212
12332024-11-14T00:30:19.138ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12342024-11-14T00:30:19.138ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12352024-11-14T00:30:19.141ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12362024-11-14T00:30:19.141ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12372024-11-14T00:30:19.143ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
12382024-11-14T00:30:19.143ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12392024-11-14T00:30:19.144ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteNat
12402024-11-14T00:30:19.145ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
12412024-11-14T00:30:19.145ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12422024-11-14T00:30:19.145ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12432024-11-14T00:30:19.146ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
12442024-11-14T00:30:19.147ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
12452024-11-14T00:30:19.147ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
12462024-11-14T00:30:19.147ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
12472024-11-14T00:30:19.151ZDEBGnexus: notifying dendrite of updates instance_id = Some(e21ef448-9c04-42c3-96f9-7b85864c1212 (instance)) switch = switch0
12482024-11-14T00:30:19.151ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1718, tv_nsec: 868765046 } })
12492024-11-14T00:30:19.152ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
12502024-11-14T00:30:19.182ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
12512024-11-14T00:30:19.182ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12522024-11-14T00:30:19.182ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "46955789-5f6b-45e4-a9c1-77c2c37bbe3b", "content-length": "26", "date": "Thu, 14 Nov 2024 00:30:19 GMT"} })
12532024-11-14T00:30:19.182ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12542024-11-14T00:30:19.183ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12552024-11-14T00:30:19.212ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
12562024-11-14T00:30:19.212ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c169a54-f58d-4b3b-8972-7bd81bde12e1", "content-length": "4", "date": "Thu, 14 Nov 2024 00:30:18 GMT"} })
12572024-11-14T00:30:19.213ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
12582024-11-14T00:30:19.213ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150
12592024-11-14T00:30:19.218ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
12602024-11-14T00:30:19.218ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150
12612024-11-14T00:30:19.223ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12622024-11-14T00:30:19.223ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12632024-11-14T00:30:19.225ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12642024-11-14T00:30:19.226ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12652024-11-14T00:30:19.227ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12662024-11-14T00:30:19.227ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12672024-11-14T00:30:19.229ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12682024-11-14T00:30:19.230ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12692024-11-14T00:30:19.232ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12702024-11-14T00:30:19.234ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12712024-11-14T00:30:19.234ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12722024-11-14T00:30:19.234ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12732024-11-14T00:30:19.309ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12742024-11-14T00:30:19.309ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12752024-11-14T00:30:19.323ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12762024-11-14T00:30:19.324ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = InstanceDeleteRecord
12772024-11-14T00:30:19.326ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
12782024-11-14T00:30:19.326ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150
12792024-11-14T00:30:19.330ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
12802024-11-14T00:30:19.330ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150
12812024-11-14T00:30:19.333ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12822024-11-14T00:30:19.334ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12832024-11-14T00:30:19.336ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12842024-11-14T00:30:19.336ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12852024-11-14T00:30:19.338ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12862024-11-14T00:30:19.338ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12872024-11-14T00:30:19.340ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12882024-11-14T00:30:19.340ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12892024-11-14T00:30:19.342ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12902024-11-14T00:30:19.345ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: e21ef448-9c04-42c3-96f9-7b85864c1212, lookup_type: ByName("instance-c9025c66cce") } result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12912024-11-14T00:30:19.345ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12922024-11-14T00:30:19.345ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
12932024-11-14T00:30:19.354ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
12942024-11-14T00:30:19.354ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150
12952024-11-14T00:30:19.355ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
12962024-11-14T00:30:19.355ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12972024-11-14T00:30:19.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12982024-11-14T00:30:19.358ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
12992024-11-14T00:30:19.358ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150
13002024-11-14T00:30:19.363ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeallocateExternalIp
13012024-11-14T00:30:19.363ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeallocateExternalIp
13022024-11-14T00:30:19.367ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13032024-11-14T00:30:19.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13042024-11-14T00:30:19.372ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeallocateExternalIp
13052024-11-14T00:30:19.372ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_node = DeallocateExternalIp
13062024-11-14T00:30:19.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13072024-11-14T00:30:19.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13082024-11-14T00:30:19.376ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13092024-11-14T00:30:19.378ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13102024-11-14T00:30:19.378ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13112024-11-14T00:30:19.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13122024-11-14T00:30:19.379ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13132024-11-14T00:30:19.381ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13142024-11-14T00:30:19.381ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13152024-11-14T00:30:19.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13162024-11-14T00:30:19.415ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
13172024-11-14T00:30:19.416ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3e6cd6b-1fd3-458a-8c1d-bcb0c3496a2d", "content-length": "691", "date": "Thu, 14 Nov 2024 00:30:19 GMT"} })
13182024-11-14T00:30:19.416ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
13192024-11-14T00:30:19.416ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
13202024-11-14T00:30:19.416ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
13212024-11-14T00:30:19.419ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 64.437587ms iteration = 25 status = {}
13222024-11-14T00:30:19.450ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
13232024-11-14T00:30:19.450ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150
13242024-11-14T00:30:19.454ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
13252024-11-14T00:30:19.454ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150
13262024-11-14T00:30:19.458ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
13272024-11-14T00:30:19.458ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150
13282024-11-14T00:30:19.461ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
13292024-11-14T00:30:19.461ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150
13302024-11-14T00:30:19.494ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
13312024-11-14T00:30:19.494ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 6c08f51c-a9be-40e5-93dd-8aaf34c8d150 saga_name = instance-delete saga_result = SagaResult { saga_id: 6c08f51c-a9be-40e5-93dd-8aaf34c8d150, saga_log: SagaLog { saga_id: 6c08f51c-a9be-40e5-93dd-8aaf34c8d150, unwinding: false, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N005 started, N005 succeeded], node_status: {0: Succeeded(Null), 1: Succeeded(Null), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"no_result1": Null, "no_result2": Null, "no_result3": Null, "no_result4": Null} }) }
13322024-11-14T00:30:19.494ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
13332024-11-14T00:30:19.494ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13342024-11-14T00:30:19.494ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 450824 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = a8b09d4f-99af-476b-966b-f0d365271d94 response_code = 204 uri = /v1/instances/instance-c9025c66cce?project=proj-c66a78d0335
13352024-11-14T00:30:19.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13362024-11-14T00:30:19.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13372024-11-14T00:30:19.495ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13382024-11-14T00:30:19.496ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13392024-11-14T00:30:19.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13402024-11-14T00:30:19.497ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13412024-11-14T00:30:19.497ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13422024-11-14T00:30:19.498ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13432024-11-14T00:30:19.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13442024-11-14T00:30:19.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13452024-11-14T00:30:19.499ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
13462024-11-14T00:30:19.500ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13472024-11-14T00:30:19.500ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
13482024-11-14T00:30:19.500ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13492024-11-14T00:30:19.500ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13502024-11-14T00:30:19.501ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13512024-11-14T00:30:19.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13522024-11-14T00:30:19.501ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13532024-11-14T00:30:19.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13542024-11-14T00:30:19.502ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13552024-11-14T00:30:19.503ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13562024-11-14T00:30:19.504ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13572024-11-14T00:30:19.505ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13582024-11-14T00:30:19.505ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13592024-11-14T00:30:19.507ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
13602024-11-14T00:30:19.508ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
13612024-11-14T00:30:19.508ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13622024-11-14T00:30:19.508ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13632024-11-14T00:30:19.509ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
13642024-11-14T00:30:19.510ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
13652024-11-14T00:30:19.510ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13662024-11-14T00:30:19.510ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13672024-11-14T00:30:19.534ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13682024-11-14T00:30:19.534ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13692024-11-14T00:30:19.534ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "83600e14-e0ff-4bca-80a7-10d6d5805735", "content-length": "372", "date": "Thu, 14 Nov 2024 00:30:19 GMT"} })
13702024-11-14T00:30:19.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13712024-11-14T00:30:19.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13722024-11-14T00:30:19.538ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13732024-11-14T00:30:19.538ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13742024-11-14T00:30:19.539ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13752024-11-14T00:30:19.539ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13762024-11-14T00:30:19.541ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13772024-11-14T00:30:19.541ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13782024-11-14T00:30:19.542ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13792024-11-14T00:30:19.542ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13802024-11-14T00:30:19.543ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
13812024-11-14T00:30:19.544ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
13822024-11-14T00:30:19.544ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13832024-11-14T00:30:19.544ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13842024-11-14T00:30:19.546ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13852024-11-14T00:30:19.547ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13862024-11-14T00:30:19.548ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
13872024-11-14T00:30:19.548ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
13882024-11-14T00:30:19.549ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
13892024-11-14T00:30:19.549ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
13902024-11-14T00:30:19.549ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5f4260a0-ec16-4c92-9a15-88dd0ad805a6", "date": "Thu, 14 Nov 2024 00:30:19 GMT"} })
13912024-11-14T00:30:19.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13922024-11-14T00:30:19.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13932024-11-14T00:30:19.549ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
13942024-11-14T00:30:19.550ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
13952024-11-14T00:30:19.550ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
13962024-11-14T00:30:19.551ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Database result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
13972024-11-14T00:30:19.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13982024-11-14T00:30:19.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13992024-11-14T00:30:19.552ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14002024-11-14T00:30:19.552ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Database result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14012024-11-14T00:30:19.553ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14022024-11-14T00:30:19.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14032024-11-14T00:30:19.554ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14042024-11-14T00:30:19.554ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Database result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14052024-11-14T00:30:19.556ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
14062024-11-14T00:30:19.556ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
14072024-11-14T00:30:19.556ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14082024-11-14T00:30:19.556ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Database result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14092024-11-14T00:30:19.556ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "69134948-2a50-4a67-91ae-7a62dcb0e663", "date": "Thu, 14 Nov 2024 00:30:19 GMT"} })
14102024-11-14T00:30:19.557ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 63.614645ms iteration = 26 status = {}
14112024-11-14T00:30:19.558ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14122024-11-14T00:30:19.558ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Database result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14132024-11-14T00:30:19.561ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14142024-11-14T00:30:19.561ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Database result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14152024-11-14T00:30:19.563ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14162024-11-14T00:30:19.563ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Database result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14172024-11-14T00:30:19.566ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14182024-11-14T00:30:19.568ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: 64ab900b-4058-4c6e-9b6e-5704580f39a6, lookup_type: ByName("disk-c10d2442f44") } result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14192024-11-14T00:30:19.568ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14202024-11-14T00:30:19.568ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Database result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14212024-11-14T00:30:19.570ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14222024-11-14T00:30:19.570ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Database result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14232024-11-14T00:30:19.572ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14242024-11-14T00:30:19.572ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Database result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14252024-11-14T00:30:19.573ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14262024-11-14T00:30:19.573ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Database result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14272024-11-14T00:30:19.575ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14282024-11-14T00:30:19.576ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Database result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14292024-11-14T00:30:19.578ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14302024-11-14T00:30:19.578ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Database result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14312024-11-14T00:30:19.580ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14322024-11-14T00:30:19.580ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Database result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14332024-11-14T00:30:19.582ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14342024-11-14T00:30:19.584ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ById(17b1ded6-f8f1-45cb-8443-dafcf0963e1d) }, key: 64ab900b-4058-4c6e-9b6e-5704580f39a6, lookup_type: ById(64ab900b-4058-4c6e-9b6e-5704580f39a6) } result = Ok(()) uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
14352024-11-14T00:30:19.584ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete
14362024-11-14T00:30:19.584ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[3,4,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"bf9014ac-edb7-4293-a1ff-4004060e0581","silo_user_id":"2a6d5982-5d0f-4844-9dca-f3d9f0d527e6"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"ec4a4c3a-cf5b-4270-bb13-36e4b169f651"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.find_freed_crucible_regions","label":"FindFreedCrucibleRegions","name":"freed_crucible_regions"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"volume_hard_deleted"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"64ab900b-4058-4c6e-9b6e-5704580f39a6","project_id":"17b1ded6-f8f1-45cb-8443-dafcf0963e1d","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"bf9014ac-edb7-4293-a1ff-4004060e0581","silo_user_id":"2a6d5982-5d0f-4844-9dca-f3d9f0d527e6"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"ec4a4c3a-cf5b-4270-bb13-36e4b169f651"}}},"End"]},"saga_name":"disk-delete","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14372024-11-14T00:30:19.584ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete
14382024-11-14T00:30:19.588ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete
14392024-11-14T00:30:19.588ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14402024-11-14T00:30:19.588ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14412024-11-14T00:30:19.588ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14422024-11-14T00:30:19.592ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14432024-11-14T00:30:19.592ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14442024-11-14T00:30:19.595ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14452024-11-14T00:30:19.595ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14462024-11-14T00:30:19.607ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14472024-11-14T00:30:19.607ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": String("44f57275-cec7-46fc-b6eb-80db32caaf60"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("64ab900b-4058-4c6e-9b6e-5704580f39a6"), "name": String("disk-c10d2442f44"), "time_created": String("2024-11-14T00:29:54.161588Z"), "time_deleted": Null, "time_modified": String("2024-11-14T00:29:54.161588Z")}, "pantry_address": Null, "project_id": String("17b1ded6-f8f1-45cb-8443-dafcf0963e1d"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-14T00:29:54.742207Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("ec4a4c3a-cf5b-4270-bb13-36e4b169f651")}) node_id = 0 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14482024-11-14T00:30:19.611ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14492024-11-14T00:30:19.611ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14502024-11-14T00:30:19.614ZDEBGnexus (SagaExecutor): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true roles = RoleSet { roles: {} } saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete saga_node = SpaceAccount
14512024-11-14T00:30:19.614ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true resource = Database result = Ok(()) saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete saga_node = SpaceAccount
14522024-11-14T00:30:19.627ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14532024-11-14T00:30:19.627ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14542024-11-14T00:30:19.630ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14552024-11-14T00:30:19.630ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14562024-11-14T00:30:19.633ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14572024-11-14T00:30:19.633ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("bf9014ac-edb7-4293-a1ff-4004060e0581"), "silo_user_id": String("2a6d5982-5d0f-4844-9dca-f3d9f0d527e6")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("ec4a4c3a-cf5b-4270-bb13-36e4b169f651")}) node_id = 2 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14582024-11-14T00:30:19.636ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14592024-11-14T00:30:19.636ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14602024-11-14T00:30:19.639ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14612024-11-14T00:30:19.640ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14622024-11-14T00:30:19.642ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14632024-11-14T00:30:19.642ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14642024-11-14T00:30:19.724ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14652024-11-14T00:30:19.724ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("257e68bf-5d46-4bba-a9ab-0f62c6212bc5"), String("25179fa4-a965-43fb-83d6-e724c162d4f4"), String("ed7362e3-4d5c-445e-84b0-f250003977c9")]}}) node_id = 4 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14662024-11-14T00:30:19.728ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14672024-11-14T00:30:19.728ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14682024-11-14T00:30:19.732ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14692024-11-14T00:30:19.732ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14702024-11-14T00:30:19.737ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14712024-11-14T00:30:19.737ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14722024-11-14T00:30:19.769ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 122.159681ms file = nexus/src/app/crucible.rs:827 region_id = ed7362e3-4d5c-445e-84b0-f250003977c9 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete
14732024-11-14T00:30:19.770ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 55.248881ms file = nexus/src/app/crucible.rs:827 region_id = 25179fa4-a965-43fb-83d6-e724c162d4f4 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete
14742024-11-14T00:30:19.771ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 85.110065ms file = nexus/src/app/crucible.rs:827 region_id = 257e68bf-5d46-4bba-a9ab-0f62c6212bc5 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete
14752024-11-14T00:30:19.830ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 107.657289ms file = nexus/src/app/crucible.rs:827 region_id = 25179fa4-a965-43fb-83d6-e724c162d4f4 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete
14762024-11-14T00:30:19.861ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 257e68bf-5d46-4bba-a9ab-0f62c6212bc5 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete
14772024-11-14T00:30:19.895ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = ed7362e3-4d5c-445e-84b0-f250003977c9 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete
14782024-11-14T00:30:19.943ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 25179fa4-a965-43fb-83d6-e724c162d4f4 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete
14792024-11-14T00:30:19.969ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14802024-11-14T00:30:19.969ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14812024-11-14T00:30:19.973ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14822024-11-14T00:30:19.973ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14832024-11-14T00:30:19.977ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14842024-11-14T00:30:19.977ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14852024-11-14T00:30:19.981ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14862024-11-14T00:30:19.981ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14872024-11-14T00:30:19.984ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14882024-11-14T00:30:19.984ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14892024-11-14T00:30:19.987ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14902024-11-14T00:30:19.987ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14912024-11-14T00:30:19.995ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14922024-11-14T00:30:19.995ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 9 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14932024-11-14T00:30:19.998ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14942024-11-14T00:30:19.998ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14952024-11-14T00:30:20.002ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14962024-11-14T00:30:20.002ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14972024-11-14T00:30:20.005ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
14982024-11-14T00:30:20.005ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
14992024-11-14T00:30:20.010ZINFOnexus (SagaExecutor): allocated regions for ec4a4c3a-cf5b-4270-bb13-36e4b169f651 is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:531 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete
15002024-11-14T00:30:20.014ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
15012024-11-14T00:30:20.014ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
15022024-11-14T00:30:20.018ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
15032024-11-14T00:30:20.018ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
15042024-11-14T00:30:20.021ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
15052024-11-14T00:30:20.021ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
15062024-11-14T00:30:20.024ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
15072024-11-14T00:30:20.024ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
15082024-11-14T00:30:20.029ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
15092024-11-14T00:30:20.029ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
15102024-11-14T00:30:20.032ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
15112024-11-14T00:30:20.032ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2
15122024-11-14T00:30:20.040ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete sec_id = b501ed1c-871c-451e-b97c-1d88e152ca13
15132024-11-14T00:30:20.040ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = b81f5317-937e-4025-a7f1-bc86d43f48c2 saga_name = disk-delete saga_result = SagaResult { saga_id: b81f5317-937e-4025-a7f1-bc86d43f48c2, saga_log: SagaLog { saga_id: b81f5317-937e-4025-a7f1-bc86d43f48c2, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N006 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": String("44f57275-cec7-46fc-b6eb-80db32caaf60"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("64ab900b-4058-4c6e-9b6e-5704580f39a6"), "name": String("disk-c10d2442f44"), "time_created": String("2024-11-14T00:29:54.161588Z"), "time_deleted": Null, "time_modified": String("2024-11-14T00:29:54.161588Z")}, "pantry_address": Null, "project_id": String("17b1ded6-f8f1-45cb-8443-dafcf0963e1d"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-14T00:29:54.742207Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("ec4a4c3a-cf5b-4270-bb13-36e4b169f651")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("bf9014ac-edb7-4293-a1ff-4004060e0581"), "silo_user_id": String("2a6d5982-5d0f-4844-9dca-f3d9f0d527e6")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("ec4a4c3a-cf5b-4270-bb13-36e4b169f651")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("257e68bf-5d46-4bba-a9ab-0f62c6212bc5"), String("25179fa4-a965-43fb-83d6-e724c162d4f4"), String("ed7362e3-4d5c-445e-84b0-f250003977c9")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Array []), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("257e68bf-5d46-4bba-a9ab-0f62c6212bc5"), String("25179fa4-a965-43fb-83d6-e724c162d4f4"), String("ed7362e3-4d5c-445e-84b0-f250003977c9")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": String("44f57275-cec7-46fc-b6eb-80db32caaf60"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("64ab900b-4058-4c6e-9b6e-5704580f39a6"), "name": String("disk-c10d2442f44"), "time_created": String("2024-11-14T00:29:54.161588Z"), "time_deleted": Null, "time_modified": String("2024-11-14T00:29:54.161588Z")}, "pantry_address": Null, "project_id": String("17b1ded6-f8f1-45cb-8443-dafcf0963e1d"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-14T00:29:54.742207Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("ec4a4c3a-cf5b-4270-bb13-36e4b169f651")}, "freed_crucible_regions": Array [], "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("bf9014ac-edb7-4293-a1ff-4004060e0581"), "silo_user_id": String("2a6d5982-5d0f-4844-9dca-f3d9f0d527e6")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("ec4a4c3a-cf5b-4270-bb13-36e4b169f651")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
15142024-11-14T00:30:20.040ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 544693 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 10495329-dabb-43af-8cc0-35318d441315 response_code = 204 uri = /v1/disks/disk-c10d2442f44?project=proj-c66a78d0335
15152024-11-14T00:30:20.041ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15162024-11-14T00:30:20.041ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15172024-11-14T00:30:20.043ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15182024-11-14T00:30:20.043ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15192024-11-14T00:30:20.044ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
15202024-11-14T00:30:20.046ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
15212024-11-14T00:30:20.046ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15222024-11-14T00:30:20.046ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15232024-11-14T00:30:20.047ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15242024-11-14T00:30:20.047ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15252024-11-14T00:30:20.049ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15262024-11-14T00:30:20.049ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15272024-11-14T00:30:20.050ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15282024-11-14T00:30:20.050ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15292024-11-14T00:30:20.052ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
15302024-11-14T00:30:20.053ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
15312024-11-14T00:30:20.053ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15322024-11-14T00:30:20.053ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15332024-11-14T00:30:20.054ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
15342024-11-14T00:30:20.055ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
15352024-11-14T00:30:20.055ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15362024-11-14T00:30:20.055ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15372024-11-14T00:30:20.060ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15382024-11-14T00:30:20.060ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15392024-11-14T00:30:20.062ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15402024-11-14T00:30:20.062ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15412024-11-14T00:30:20.063ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15422024-11-14T00:30:20.063ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15432024-11-14T00:30:20.065ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15442024-11-14T00:30:20.065ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15452024-11-14T00:30:20.066ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
15462024-11-14T00:30:20.067ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
15472024-11-14T00:30:20.067ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15482024-11-14T00:30:20.068ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15492024-11-14T00:30:20.069ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15502024-11-14T00:30:20.069ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15512024-11-14T00:30:20.070ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15522024-11-14T00:30:20.071ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15532024-11-14T00:30:20.072ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
15542024-11-14T00:30:20.073ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
15552024-11-14T00:30:20.073ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15562024-11-14T00:30:20.073ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15572024-11-14T00:30:20.075ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15582024-11-14T00:30:20.075ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15592024-11-14T00:30:20.076ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15602024-11-14T00:30:20.076ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15612024-11-14T00:30:20.078ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15622024-11-14T00:30:20.078ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15632024-11-14T00:30:20.080ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15642024-11-14T00:30:20.080ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15652024-11-14T00:30:20.082ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15662024-11-14T00:30:20.083ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15672024-11-14T00:30:20.085ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15682024-11-14T00:30:20.085ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15692024-11-14T00:30:20.087ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15702024-11-14T00:30:20.087ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15712024-11-14T00:30:20.089ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15722024-11-14T00:30:20.092ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: bffc383e-a189-4062-ba8b-2f71d77ef06e, lookup_type: ByName("default") }, key: 56c27358-fab8-45ee-af72-5739c9f9ac8c, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15732024-11-14T00:30:20.092ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15742024-11-14T00:30:20.092ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15752024-11-14T00:30:20.094ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15762024-11-14T00:30:20.094ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15772024-11-14T00:30:20.097ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15782024-11-14T00:30:20.097ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15792024-11-14T00:30:20.099ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15802024-11-14T00:30:20.099ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15812024-11-14T00:30:20.101ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15822024-11-14T00:30:20.104ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: bffc383e-a189-4062-ba8b-2f71d77ef06e, lookup_type: ByName("default") }, key: 56c27358-fab8-45ee-af72-5739c9f9ac8c, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15832024-11-14T00:30:20.104ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15842024-11-14T00:30:20.104ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15852024-11-14T00:30:20.106ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15862024-11-14T00:30:20.106ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15872024-11-14T00:30:20.111ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15882024-11-14T00:30:20.111ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15892024-11-14T00:30:20.146ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15902024-11-14T00:30:20.146ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15912024-11-14T00:30:20.151ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 110197 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = edfe04ea-bc10-4dfa-9e3b-30ca8696e90a response_code = 204 uri = /v1/vpc-subnets/default?project=proj-c66a78d0335&vpc=default
15922024-11-14T00:30:20.151ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Signaled
15932024-11-14T00:30:20.151ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15942024-11-14T00:30:20.151ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15952024-11-14T00:30:20.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15962024-11-14T00:30:20.152ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
15972024-11-14T00:30:20.152ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
15982024-11-14T00:30:20.153ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15992024-11-14T00:30:20.154ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16002024-11-14T00:30:20.154ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16012024-11-14T00:30:20.155ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16022024-11-14T00:30:20.155ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16032024-11-14T00:30:20.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16042024-11-14T00:30:20.155ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
16052024-11-14T00:30:20.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16062024-11-14T00:30:20.157ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
16072024-11-14T00:30:20.157ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16082024-11-14T00:30:20.157ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16092024-11-14T00:30:20.158ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16102024-11-14T00:30:20.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16112024-11-14T00:30:20.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16122024-11-14T00:30:20.158ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16132024-11-14T00:30:20.158ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16142024-11-14T00:30:20.160ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16152024-11-14T00:30:20.160ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16162024-11-14T00:30:20.161ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16172024-11-14T00:30:20.161ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16182024-11-14T00:30:20.162ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
16192024-11-14T00:30:20.163ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
16202024-11-14T00:30:20.163ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16212024-11-14T00:30:20.164ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16222024-11-14T00:30:20.165ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
16232024-11-14T00:30:20.166ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
16242024-11-14T00:30:20.166ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16252024-11-14T00:30:20.166ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16262024-11-14T00:30:20.190ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16272024-11-14T00:30:20.190ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16282024-11-14T00:30:20.191ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a91a6057-83f0-4fa5-874a-c0926ff43cf6", "content-length": "372", "date": "Thu, 14 Nov 2024 00:30:19 GMT"} })
16292024-11-14T00:30:20.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16302024-11-14T00:30:20.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16312024-11-14T00:30:20.194ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16322024-11-14T00:30:20.194ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16332024-11-14T00:30:20.195ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16342024-11-14T00:30:20.195ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16352024-11-14T00:30:20.200ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16362024-11-14T00:30:20.200ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16372024-11-14T00:30:20.203ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16382024-11-14T00:30:20.203ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16392024-11-14T00:30:20.204ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
16402024-11-14T00:30:20.206ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
16412024-11-14T00:30:20.206ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16422024-11-14T00:30:20.206ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16432024-11-14T00:30:20.208ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16442024-11-14T00:30:20.208ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16452024-11-14T00:30:20.210ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
16462024-11-14T00:30:20.210ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
16472024-11-14T00:30:20.210ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16482024-11-14T00:30:20.211ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16492024-11-14T00:30:20.211ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6e8b16ee-9e1c-44e6-8f5b-ce4f67ef9e75", "date": "Thu, 14 Nov 2024 00:30:19 GMT"} })
16502024-11-14T00:30:20.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16512024-11-14T00:30:20.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16522024-11-14T00:30:20.211ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
16532024-11-14T00:30:20.212ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
16542024-11-14T00:30:20.212ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16552024-11-14T00:30:20.213ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16562024-11-14T00:30:20.213ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16572024-11-14T00:30:20.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16582024-11-14T00:30:20.214ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16592024-11-14T00:30:20.214ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16602024-11-14T00:30:20.215ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16612024-11-14T00:30:20.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16622024-11-14T00:30:20.216ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16632024-11-14T00:30:20.216ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16642024-11-14T00:30:20.218ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16652024-11-14T00:30:20.218ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16662024-11-14T00:30:20.218ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16672024-11-14T00:30:20.218ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16682024-11-14T00:30:20.218ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7a678e26-1e7b-4c0f-8eef-7f5a99e18de5", "date": "Thu, 14 Nov 2024 00:30:19 GMT"} })
16692024-11-14T00:30:20.220ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16702024-11-14T00:30:20.220ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16712024-11-14T00:30:20.221ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 69.409077ms iteration = 27 status = {}
16722024-11-14T00:30:20.222ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16732024-11-14T00:30:20.222ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16742024-11-14T00:30:20.225ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16752024-11-14T00:30:20.225ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16762024-11-14T00:30:20.227ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16772024-11-14T00:30:20.230ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: bffc383e-a189-4062-ba8b-2f71d77ef06e, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16782024-11-14T00:30:20.230ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16792024-11-14T00:30:20.230ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16802024-11-14T00:30:20.232ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16812024-11-14T00:30:20.232ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16822024-11-14T00:30:20.235ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16832024-11-14T00:30:20.235ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16842024-11-14T00:30:20.236ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16852024-11-14T00:30:20.236ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16862024-11-14T00:30:20.239ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16872024-11-14T00:30:20.241ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: bffc383e-a189-4062-ba8b-2f71d77ef06e, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16882024-11-14T00:30:20.241ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16892024-11-14T00:30:20.241ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16902024-11-14T00:30:20.243ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16912024-11-14T00:30:20.243ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16922024-11-14T00:30:20.248ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16932024-11-14T00:30:20.248ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16942024-11-14T00:30:20.250ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16952024-11-14T00:30:20.250ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16962024-11-14T00:30:20.252ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16972024-11-14T00:30:20.252ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
16982024-11-14T00:30:20.254ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
16992024-11-14T00:30:20.254ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
17002024-11-14T00:30:20.257ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/vpcs/default?project=proj-c66a78d0335
17012024-11-14T00:30:20.259ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: bffc383e-a189-4062-ba8b-2f71d77ef06e, lookup_type: ByName("default") }, key: 7b89b865-b3ed-4821-b4a5-5eac407c7914, lookup_type: ById(7b89b865-b3ed-4821-b4a5-5eac407c7914) } result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
17022024-11-14T00:30:20.259ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
17032024-11-14T00:30:20.260ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
17042024-11-14T00:30:20.264ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
17052024-11-14T00:30:20.265ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
17062024-11-14T00:30:20.270ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
17072024-11-14T00:30:20.270ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
17082024-11-14T00:30:20.272ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
17092024-11-14T00:30:20.272ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
17102024-11-14T00:30:20.274ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
17112024-11-14T00:30:20.274ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
17122024-11-14T00:30:20.277ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
17132024-11-14T00:30:20.277ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
17142024-11-14T00:30:20.279ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
17152024-11-14T00:30:20.279ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
17162024-11-14T00:30:20.282ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/vpcs/default?project=proj-c66a78d0335
17172024-11-14T00:30:20.284ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") }, key: bffc383e-a189-4062-ba8b-2f71d77ef06e, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
17182024-11-14T00:30:20.284ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-c66a78d0335
17192024-11-14T00:30:20.284ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-c66a78d0335
17202024-11-14T00:30:20.290ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 137916 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = d14a891f-0171-461d-a451-96c825f8b8d3 response_code = 204 uri = /v1/vpcs/default?project=proj-c66a78d0335
17212024-11-14T00:30:20.291ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17222024-11-14T00:30:20.291ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17232024-11-14T00:30:20.292ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17242024-11-14T00:30:20.292ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17252024-11-14T00:30:20.294ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17262024-11-14T00:30:20.295ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("token = \\"6fdc14dda122a01990aba52bded5f9525fc0bdbc\\"") } result = Ok(())
17272024-11-14T00:30:20.295ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17282024-11-14T00:30:20.295ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17292024-11-14T00:30:20.296ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17302024-11-14T00:30:20.296ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17312024-11-14T00:30:20.297ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17322024-11-14T00:30:20.297ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17332024-11-14T00:30:20.298ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17342024-11-14T00:30:20.299ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17352024-11-14T00:30:20.300ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17362024-11-14T00:30:20.301ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
17372024-11-14T00:30:20.301ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17382024-11-14T00:30:20.301ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17392024-11-14T00:30:20.302ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17402024-11-14T00:30:20.303ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "6fdc14dda122a01990aba52bded5f9525fc0bdbc", lookup_type: ByCompositeId("6fdc14dda122a01990aba52bded5f9525fc0bdbc") } result = Ok(())
17412024-11-14T00:30:20.303ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17422024-11-14T00:30:20.303ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17432024-11-14T00:30:20.308ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17442024-11-14T00:30:20.308ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17452024-11-14T00:30:20.309ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17462024-11-14T00:30:20.309ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17472024-11-14T00:30:20.310ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17482024-11-14T00:30:20.311ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17492024-11-14T00:30:20.312ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17502024-11-14T00:30:20.312ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17512024-11-14T00:30:20.313ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17522024-11-14T00:30:20.314ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, lookup_type: ById(2a6d5982-5d0f-4844-9dca-f3d9f0d527e6) } result = Ok(())
17532024-11-14T00:30:20.314ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17542024-11-14T00:30:20.314ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17552024-11-14T00:30:20.316ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17562024-11-14T00:30:20.316ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17572024-11-14T00:30:20.317ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
17582024-11-14T00:30:20.317ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
17592024-11-14T00:30:20.318ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
17602024-11-14T00:30:20.319ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) } result = Ok(())
17612024-11-14T00:30:20.319ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17622024-11-14T00:30:20.319ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17632024-11-14T00:30:20.320ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17642024-11-14T00:30:20.320ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17652024-11-14T00:30:20.322ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17662024-11-14T00:30:20.322ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17672024-11-14T00:30:20.324ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17682024-11-14T00:30:20.324ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17692024-11-14T00:30:20.326ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17702024-11-14T00:30:20.327ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17712024-11-14T00:30:20.328ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17722024-11-14T00:30:20.329ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17732024-11-14T00:30:20.331ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/projects/proj-c66a78d0335
17742024-11-14T00:30:20.333ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") } result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17752024-11-14T00:30:20.333ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17762024-11-14T00:30:20.333ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17772024-11-14T00:30:20.335ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17782024-11-14T00:30:20.335ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17792024-11-14T00:30:20.337ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17802024-11-14T00:30:20.338ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17812024-11-14T00:30:20.340ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17822024-11-14T00:30:20.340ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17832024-11-14T00:30:20.342ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {(Silo, bf9014ac-edb7-4293-a1ff-4004060e0581, "admin")} } uri = /v1/projects/proj-c66a78d0335
17842024-11-14T00:30:20.343ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Project { parent: Silo { parent: Fleet, key: bf9014ac-edb7-4293-a1ff-4004060e0581, lookup_type: ById(bf9014ac-edb7-4293-a1ff-4004060e0581) }, key: 17b1ded6-f8f1-45cb-8443-dafcf0963e1d, lookup_type: ByName("proj-c66a78d0335") } result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17852024-11-14T00:30:20.343ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17862024-11-14T00:30:20.343ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17872024-11-14T00:30:20.345ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17882024-11-14T00:30:20.346ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17892024-11-14T00:30:20.348ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17902024-11-14T00:30:20.348ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17912024-11-14T00:30:20.357ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17922024-11-14T00:30:20.357ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17932024-11-14T00:30:20.360ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17942024-11-14T00:30:20.360ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17952024-11-14T00:30:20.362ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17962024-11-14T00:30:20.363ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17972024-11-14T00:30:20.364ZDEBGnexus (dropshot_external): roles actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 roles = RoleSet { roles: {} } uri = /v1/projects/proj-c66a78d0335
17982024-11-14T00:30:20.364ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6, silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, .. }) actor_id = 2a6d5982-5d0f-4844-9dca-f3d9f0d527e6 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 resource = Database result = Ok(()) uri = /v1/projects/proj-c66a78d0335
17992024-11-14T00:30:20.375ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 84380 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:33930 req_id = 53f3f05c-d4b4-4a99-8c67-aed79702c8c9 response_code = 204 uri = /v1/projects/proj-c66a78d0335
18002024-11-14T00:30:23.155ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
18012024-11-14T00:30:23.155ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18022024-11-14T00:30:23.155ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
18032024-11-14T00:30:23.155ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
18042024-11-14T00:30:23.155ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
18052024-11-14T00:30:23.155ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18062024-11-14T00:30:23.155ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18072024-11-14T00:30:23.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18082024-11-14T00:30:23.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18092024-11-14T00:30:23.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18102024-11-14T00:30:23.156ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
18112024-11-14T00:30:23.156ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18122024-11-14T00:30:23.156ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
18132024-11-14T00:30:23.156ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18142024-11-14T00:30:23.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18152024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
18162024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18172024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18182024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
18192024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18202024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18212024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
18222024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18232024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18242024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
18252024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18262024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18272024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
18282024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18292024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18302024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18312024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
18322024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18332024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
18342024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18352024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18362024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18372024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18382024-11-14T00:30:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18392024-11-14T00:30:23.159ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
18402024-11-14T00:30:23.159ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
18412024-11-14T00:30:23.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18422024-11-14T00:30:23.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18432024-11-14T00:30:23.159ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
18442024-11-14T00:30:23.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18452024-11-14T00:30:23.159ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
18462024-11-14T00:30:23.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18472024-11-14T00:30:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18482024-11-14T00:30:23.159ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18492024-11-14T00:30:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18502024-11-14T00:30:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18512024-11-14T00:30:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18522024-11-14T00:30:23.160ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1722, tv_nsec: 877086902 } })
18532024-11-14T00:30:23.160ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
18542024-11-14T00:30:23.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18552024-11-14T00:30:23.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18562024-11-14T00:30:23.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18572024-11-14T00:30:23.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18582024-11-14T00:30:23.165ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18592024-11-14T00:30:23.166ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18602024-11-14T00:30:23.166ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 11.474582ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18612024-11-14T00:30:23.166ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1722, tv_nsec: 883875667 } })
18622024-11-14T00:30:23.167ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
18632024-11-14T00:30:23.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18642024-11-14T00:30:23.168ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18652024-11-14T00:30:23.168ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18662024-11-14T00:30:23.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18672024-11-14T00:30:23.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18682024-11-14T00:30:23.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18692024-11-14T00:30:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18702024-11-14T00:30:23.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18712024-11-14T00:30:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18722024-11-14T00:30:23.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18732024-11-14T00:30:23.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18742024-11-14T00:30:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18752024-11-14T00:30:23.172ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18762024-11-14T00:30:23.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18772024-11-14T00:30:23.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18782024-11-14T00:30:23.173ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18792024-11-14T00:30:23.173ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18802024-11-14T00:30:23.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18812024-11-14T00:30:23.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.106518ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
18822024-11-14T00:30:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18832024-11-14T00:30:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18842024-11-14T00:30:23.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18852024-11-14T00:30:23.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18862024-11-14T00:30:23.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18872024-11-14T00:30:23.174ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18882024-11-14T00:30:23.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18892024-11-14T00:30:23.176ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18902024-11-14T00:30:23.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18912024-11-14T00:30:23.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18922024-11-14T00:30:23.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18932024-11-14T00:30:23.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18942024-11-14T00:30:23.179ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18952024-11-14T00:30:23.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18962024-11-14T00:30:23.180ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18972024-11-14T00:30:23.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18982024-11-14T00:30:23.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18992024-11-14T00:30:23.182ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 25.467498ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19002024-11-14T00:30:23.183ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19012024-11-14T00:30:23.183ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.065221ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19022024-11-14T00:30:23.183ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19032024-11-14T00:30:23.183ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19042024-11-14T00:30:23.183ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19052024-11-14T00:30:23.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19062024-11-14T00:30:23.184ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19072024-11-14T00:30:23.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19082024-11-14T00:30:23.185ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1722, tv_nsec: 902212965 } })
19092024-11-14T00:30:23.185ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
19102024-11-14T00:30:23.186ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19112024-11-14T00:30:23.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19122024-11-14T00:30:23.189ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19132024-11-14T00:30:23.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19142024-11-14T00:30:23.209ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19152024-11-14T00:30:23.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19162024-11-14T00:30:23.210ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19172024-11-14T00:30:23.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19182024-11-14T00:30:23.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19192024-11-14T00:30:23.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19202024-11-14T00:30:23.215ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19212024-11-14T00:30:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e211d163-be78-4663-b73f-baf5e9462a10, lookup_type: ById(e211d163-be78-4663-b73f-baf5e9462a10) } result = Ok(())
19222024-11-14T00:30:23.219ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19232024-11-14T00:30:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19242024-11-14T00:30:23.224ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.178137ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
19252024-11-14T00:30:23.226ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.450957ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19262024-11-14T00:30:23.226ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.30781ms iteration = 24 status = 0
19272024-11-14T00:30:23.227ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19282024-11-14T00:30:23.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19292024-11-14T00:30:23.228ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.763851ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
19302024-11-14T00:30:23.230ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19312024-11-14T00:30:23.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
19322024-11-14T00:30:23.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19332024-11-14T00:30:23.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19342024-11-14T00:30:23.237ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19352024-11-14T00:30:23.237ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19362024-11-14T00:30:23.237ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 80.939709ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19372024-11-14T00:30:23.242ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
19382024-11-14T00:30:23.242ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.219347ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
19392024-11-14T00:30:23.252ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
19402024-11-14T00:30:23.252ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19412024-11-14T00:30:23.252ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f4e7e2c-a428-4c3b-a6e2-ad9efd72535d", "content-length": "26", "date": "Thu, 14 Nov 2024 00:30:23 GMT"} })
19422024-11-14T00:30:23.252ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19432024-11-14T00:30:23.254ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19442024-11-14T00:30:23.258ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
19452024-11-14T00:30:23.258ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19462024-11-14T00:30:23.258ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "705fdbc4-c3a9-4220-a46c-a34f4568eecb", "content-length": "26", "date": "Thu, 14 Nov 2024 00:30:23 GMT"} })
19472024-11-14T00:30:23.258ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19482024-11-14T00:30:23.260ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19492024-11-14T00:30:23.263ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19502024-11-14T00:30:23.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19512024-11-14T00:30:23.286ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 zone_address = fd00:1122:3344:101::2
19522024-11-14T00:30:23.286ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19532024-11-14T00:30:23.287ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "92c23b77-4c54-4cd9-81b4-10df2be8665e", "content-length": "26", "date": "Thu, 14 Nov 2024 00:30:23 GMT"} })
19542024-11-14T00:30:23.287ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19552024-11-14T00:30:23.289ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
19562024-11-14T00:30:23.292ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 133.213824ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
19572024-11-14T00:30:23.302ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 145.292884ms iteration = 27 status = {"physical_disks_added":0}
19582024-11-14T00:30:23.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19592024-11-14T00:30:23.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19602024-11-14T00:30:23.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19612024-11-14T00:30:23.309ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19622024-11-14T00:30:23.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19632024-11-14T00:30:23.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19642024-11-14T00:30:23.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19652024-11-14T00:30:23.317ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19662024-11-14T00:30:23.317ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19672024-11-14T00:30:23.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19682024-11-14T00:30:23.370ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19692024-11-14T00:30:23.370ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba3cc610-f2b2-47d3-a737-c7839a1b609b", "content-length": "2", "date": "Thu, 14 Nov 2024 00:30:22 GMT"} })
19702024-11-14T00:30:23.371ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19712024-11-14T00:30:23.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19722024-11-14T00:30:23.374ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 218.780478ms iteration = 24 status = null
19732024-11-14T00:30:23.388ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 232.710475ms iteration = 24 status = {}
19742024-11-14T00:30:23.437ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19752024-11-14T00:30:23.437ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19762024-11-14T00:30:23.437ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d4b677f-1421-4859-9865-360059a91fbb", "content-length": "372", "date": "Thu, 14 Nov 2024 00:30:23 GMT"} })
19772024-11-14T00:30:23.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19782024-11-14T00:30:23.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19792024-11-14T00:30:23.452ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
19802024-11-14T00:30:23.452ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "59abad91-7282-4ee2-b9be-7dc69d2ad3f0", "content-length": "691", "date": "Thu, 14 Nov 2024 00:30:23 GMT"} })
19812024-11-14T00:30:23.452ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
19822024-11-14T00:30:23.452ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
19832024-11-14T00:30:23.452ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
19842024-11-14T00:30:23.453ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
19852024-11-14T00:30:23.453ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19862024-11-14T00:30:23.453ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f0994bd6-30b2-4af9-9b99-961ba3965dfe", "date": "Thu, 14 Nov 2024 00:30:23 GMT"} })
19872024-11-14T00:30:23.453ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19882024-11-14T00:30:23.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19892024-11-14T00:30:23.455ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 298.553081ms iteration = 26 status = {}
19902024-11-14T00:30:23.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19912024-11-14T00:30:23.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19922024-11-14T00:30:23.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19932024-11-14T00:30:23.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19942024-11-14T00:30:23.465ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
19952024-11-14T00:30:23.465ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19962024-11-14T00:30:23.465ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "01d9d975-bab4-4995-bc33-117e4c56d878", "date": "Thu, 14 Nov 2024 00:30:23 GMT"} })
19972024-11-14T00:30:23.467ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 311.022517ms iteration = 28 status = {}
19982024-11-14T00:30:23.522ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19992024-11-14T00:30:23.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20002024-11-14T00:30:23.524ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1b492b5b-8c3a-4e99-9528-5d52a91581c5, rack_id: fcfbb675-622a-4d07-9c7d-02f1c7317864, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b) } rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
20012024-11-14T00:30:23.524ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20022024-11-14T00:30:23.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20032024-11-14T00:30:23.535ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20042024-11-14T00:30:23.536ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "100525fe-a06d-47ad-91fb-8da81be2b39b", "content-length": "134", "date": "Thu, 14 Nov 2024 00:30:22 GMT"} })
20052024-11-14T00:30:23.536ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20062024-11-14T00:30:23.536ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b
20072024-11-14T00:30:23.536ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20082024-11-14T00:30:23.536ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20092024-11-14T00:30:23.536ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20102024-11-14T00:30:23.536ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20112024-11-14T00:30:23.536ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20122024-11-14T00:30:23.536ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20132024-11-14T00:30:23.536ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20142024-11-14T00:30:23.536ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20152024-11-14T00:30:23.536ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
20162024-11-14T00:30:23.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20172024-11-14T00:30:23.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20182024-11-14T00:30:23.539ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20192024-11-14T00:30:23.539ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b76540a7-494d-49d4-b839-063dc5b3827f", "content-length": "2", "date": "Thu, 14 Nov 2024 00:30:22 GMT"} })
20202024-11-14T00:30:23.539ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20212024-11-14T00:30:23.539ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "af996cf6-c31d-47be-abc5-6f1f56a23d8e", "content-length": "52", "date": "Thu, 14 Nov 2024 00:30:22 GMT"} })
20222024-11-14T00:30:23.539ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
20232024-11-14T00:30:23.539ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20242024-11-14T00:30:23.738ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "84812e59-d609-464a-9995-d5d27fa09543", "date": "Thu, 14 Nov 2024 00:30:23 GMT"} })
20252024-11-14T00:30:23.738ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch = Switch0
20262024-11-14T00:30:23.738ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20272024-11-14T00:30:23.743ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "35f294ae-0314-48fe-bc59-656202c8cad4", "content-length": "682", "date": "Thu, 14 Nov 2024 00:30:23 GMT"} })
20282024-11-14T00:30:23.743ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20292024-11-14T00:30:23.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20302024-11-14T00:30:23.746ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20312024-11-14T00:30:23.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20322024-11-14T00:30:23.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20332024-11-14T00:30:23.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20342024-11-14T00:30:23.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20352024-11-14T00:30:23.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20362024-11-14T00:30:23.760ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 603.069496ms iteration = 24 status = {}
20372024-11-14T00:30:30.951ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2432 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = f487bb9f-5dd4-4e54-aac8-767ace1c9bde response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
20382024-11-14T00:30:33.155ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
20392024-11-14T00:30:33.155ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20402024-11-14T00:30:33.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20412024-11-14T00:30:33.156ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
20422024-11-14T00:30:33.156ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20432024-11-14T00:30:33.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20442024-11-14T00:30:33.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20452024-11-14T00:30:33.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20462024-11-14T00:30:33.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20472024-11-14T00:30:33.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.880324ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20482024-11-14T00:30:33.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20492024-11-14T00:30:33.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20502024-11-14T00:30:33.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20512024-11-14T00:30:33.161ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20522024-11-14T00:30:33.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20532024-11-14T00:30:33.163ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20542024-11-14T00:30:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
20552024-11-14T00:30:33.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20562024-11-14T00:30:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20572024-11-14T00:30:33.174ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
20582024-11-14T00:30:33.174ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.227027ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
20592024-11-14T00:30:43.156ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
20602024-11-14T00:30:43.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20612024-11-14T00:30:43.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20622024-11-14T00:30:43.156ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
20632024-11-14T00:30:43.156ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20642024-11-14T00:30:43.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20652024-11-14T00:30:43.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20662024-11-14T00:30:43.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20672024-11-14T00:30:43.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20682024-11-14T00:30:43.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20692024-11-14T00:30:43.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20702024-11-14T00:30:43.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20712024-11-14T00:30:43.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20722024-11-14T00:30:43.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20732024-11-14T00:30:43.164ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20742024-11-14T00:30:43.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
20752024-11-14T00:30:43.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20762024-11-14T00:30:43.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20772024-11-14T00:30:43.177ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
20782024-11-14T00:30:43.177ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.476603ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
20792024-11-14T00:30:43.187ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.939035ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20802024-11-14T00:30:45.946ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2282 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = b4685c03-4e86-41dc-9b8e-5161649ff91d response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
20812024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
20822024-11-14T00:30:53.156ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
20832024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
20842024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
20852024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20862024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
20872024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20882024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
20892024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
20902024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
20912024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
20922024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
20932024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
20942024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20952024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20962024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
20972024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20982024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
20992024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
21002024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
21012024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21022024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21032024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
21042024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21052024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
21062024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
21072024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
21082024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
21092024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21102024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21112024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
21122024-11-14T00:30:53.156ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f
21132024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
21142024-11-14T00:30:53.156ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 00:20:53.156629652 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
21152024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.53\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f"}
21162024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
21172024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
21182024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
21192024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21202024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
21212024-11-14T00:30:53.156ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
21222024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
21232024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21242024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21252024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
21262024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
21272024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
21282024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21292024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
21302024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
21312024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21322024-11-14T00:30:53.156ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21332024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21342024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21352024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21362024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21372024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21382024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
21392024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21402024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21412024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21422024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21432024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21442024-11-14T00:30:53.157ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6880e62c-aa82-46ed-8fbf-fcd0d42c3184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("df51b222-8234-4074-91c0-cdaaebfaa9a4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("df51b222-8234-4074-91c0-cdaaebfaa9a4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1752, tv_nsec: 873727914 } })
21452024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
21462024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21472024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
21482024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21492024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
21502024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21512024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21522024-11-14T00:30:53.157ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1ab1c44d-7d9e-4861-bc1e-704f908d5ccd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("34921995-b6f6-4aad-8964-3692385af9d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("af9e2ff3-0008-44dc-81fb-c799d2026305.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("af9e2ff3-0008-44dc-81fb-c799d2026305.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1752, tv_nsec: 873777335 } })
21532024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21542024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21552024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21562024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21572024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21582024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21592024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
21602024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.203127ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
21612024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
21622024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.180687ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
21632024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21642024-11-14T00:30:53.157ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
21652024-11-14T00:30:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
21662024-11-14T00:30:53.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21672024-11-14T00:30:53.158ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
21682024-11-14T00:30:53.158ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
21692024-11-14T00:30:53.158ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21702024-11-14T00:30:53.158ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
21712024-11-14T00:30:53.158ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
21722024-11-14T00:30:53.158ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
21732024-11-14T00:30:53.158ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
21742024-11-14T00:30:53.158ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
21752024-11-14T00:30:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21762024-11-14T00:30:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
21772024-11-14T00:30:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21782024-11-14T00:30:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
21792024-11-14T00:30:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
21802024-11-14T00:30:53.159ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1752, tv_nsec: 875712892 } })
21812024-11-14T00:30:53.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21822024-11-14T00:30:53.159ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
21832024-11-14T00:30:53.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21842024-11-14T00:30:53.159ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
21852024-11-14T00:30:53.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
21862024-11-14T00:30:53.159ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
21872024-11-14T00:30:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21882024-11-14T00:30:53.159ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.279436ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
21892024-11-14T00:30:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
21902024-11-14T00:30:53.160ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21912024-11-14T00:30:53.161ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21922024-11-14T00:30:53.161ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1752, tv_nsec: 878075255 } })
21932024-11-14T00:30:53.161ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
21942024-11-14T00:30:53.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
21952024-11-14T00:30:53.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21962024-11-14T00:30:53.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21972024-11-14T00:30:53.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21982024-11-14T00:30:53.162ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21992024-11-14T00:30:53.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22002024-11-14T00:30:53.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22012024-11-14T00:30:53.164ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22022024-11-14T00:30:53.164ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22032024-11-14T00:30:53.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22042024-11-14T00:30:53.164ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22052024-11-14T00:30:53.164ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22062024-11-14T00:30:53.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22072024-11-14T00:30:53.165ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22082024-11-14T00:30:53.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
22092024-11-14T00:30:53.166ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22102024-11-14T00:30:53.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22112024-11-14T00:30:53.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
22122024-11-14T00:30:53.167ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22132024-11-14T00:30:53.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22142024-11-14T00:30:53.168ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22152024-11-14T00:30:53.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22162024-11-14T00:30:53.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
22172024-11-14T00:30:53.168ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22182024-11-14T00:30:53.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22192024-11-14T00:30:53.169ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 00:20:53.156629652 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
22202024-11-14T00:30:53.169ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.610497ms iteration = 13 status = {"expiration":"2024-11-14T00:20:53.156629652Z","pruned":[]}
22212024-11-14T00:30:53.170ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22222024-11-14T00:30:53.170ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
22232024-11-14T00:30:53.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22242024-11-14T00:30:53.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22252024-11-14T00:30:53.170ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22262024-11-14T00:30:53.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22272024-11-14T00:30:53.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
22282024-11-14T00:30:53.173ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22292024-11-14T00:30:53.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22302024-11-14T00:30:53.174ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22312024-11-14T00:30:53.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22322024-11-14T00:30:53.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22332024-11-14T00:30:53.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22342024-11-14T00:30:53.178ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22352024-11-14T00:30:53.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
22362024-11-14T00:30:53.178ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22372024-11-14T00:30:53.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22382024-11-14T00:30:53.178ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22392024-11-14T00:30:53.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
22402024-11-14T00:30:53.182ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22412024-11-14T00:30:53.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22422024-11-14T00:30:53.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22432024-11-14T00:30:53.185ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22442024-11-14T00:30:53.185ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.748627ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
22452024-11-14T00:30:53.185ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
22462024-11-14T00:30:53.186ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
22472024-11-14T00:30:53.186ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
22482024-11-14T00:30:53.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22492024-11-14T00:30:53.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22502024-11-14T00:30:53.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
22512024-11-14T00:30:53.187ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
22522024-11-14T00:30:53.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
22532024-11-14T00:30:53.190ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22542024-11-14T00:30:53.193ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22552024-11-14T00:30:53.193ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22562024-11-14T00:30:53.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22572024-11-14T00:30:53.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22582024-11-14T00:30:53.194ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22592024-11-14T00:30:53.194ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22602024-11-14T00:30:53.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22612024-11-14T00:30:53.196ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22622024-11-14T00:30:53.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22632024-11-14T00:30:53.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22642024-11-14T00:30:53.199ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 42.707012ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22652024-11-14T00:30:53.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22662024-11-14T00:30:53.204ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22672024-11-14T00:30:53.204ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
22682024-11-14T00:30:53.204ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
22692024-11-14T00:30:53.204ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
22702024-11-14T00:30:53.204ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22712024-11-14T00:30:53.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22722024-11-14T00:30:53.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22732024-11-14T00:30:53.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22742024-11-14T00:30:53.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22752024-11-14T00:30:53.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22762024-11-14T00:30:53.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22772024-11-14T00:30:53.211ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22782024-11-14T00:30:53.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22792024-11-14T00:30:53.213ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22802024-11-14T00:30:53.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22812024-11-14T00:30:53.214ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22822024-11-14T00:30:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22832024-11-14T00:30:53.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
22842024-11-14T00:30:53.218ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22852024-11-14T00:30:53.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22862024-11-14T00:30:53.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
22872024-11-14T00:30:53.218ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22882024-11-14T00:30:53.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22892024-11-14T00:30:53.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22902024-11-14T00:30:53.221ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22912024-11-14T00:30:53.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22922024-11-14T00:30:53.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22932024-11-14T00:30:53.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22942024-11-14T00:30:53.224ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
22952024-11-14T00:30:53.224ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2249d3ef-e161-463e-bd03-3f37771eab48 dns_zone_name = oxide.test found_so_far = 0 version = 2
22962024-11-14T00:30:53.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22972024-11-14T00:30:53.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22982024-11-14T00:30:53.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22992024-11-14T00:30:53.225ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23002024-11-14T00:30:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23012024-11-14T00:30:53.226ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23022024-11-14T00:30:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23032024-11-14T00:30:53.233ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 74.465828ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
23042024-11-14T00:30:53.239ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23052024-11-14T00:30:53.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23062024-11-14T00:30:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23072024-11-14T00:30:53.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 81.701239ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
23082024-11-14T00:30:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
23092024-11-14T00:30:53.241ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
23102024-11-14T00:30:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
23112024-11-14T00:30:53.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23122024-11-14T00:30:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23132024-11-14T00:30:53.243ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
23142024-11-14T00:30:53.243ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
23152024-11-14T00:30:53.243ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 84.530349ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
23162024-11-14T00:30:53.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23172024-11-14T00:30:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23182024-11-14T00:30:53.251ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23192024-11-14T00:30:53.251ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 95.408712ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23202024-11-14T00:30:53.253ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23212024-11-14T00:30:53.253ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
23222024-11-14T00:30:53.253ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23232024-11-14T00:30:53.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23242024-11-14T00:30:53.261ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
23252024-11-14T00:30:53.261ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
23262024-11-14T00:30:53.261ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 105.057268ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
23272024-11-14T00:30:53.273ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23282024-11-14T00:30:53.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23292024-11-14T00:30:53.276ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23302024-11-14T00:30:53.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23312024-11-14T00:30:53.279ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23322024-11-14T00:30:53.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23332024-11-14T00:30:53.290ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
23342024-11-14T00:30:53.290ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23352024-11-14T00:30:53.290ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "296046c5-a935-4a14-b31f-ad8a3c4f93b5", "content-length": "26", "date": "Thu, 14 Nov 2024 00:30:53 GMT"} })
23362024-11-14T00:30:53.290ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23372024-11-14T00:30:53.292ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23382024-11-14T00:30:53.295ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
23392024-11-14T00:30:53.336ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
23402024-11-14T00:30:53.336ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23412024-11-14T00:30:53.337ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "41a61872-53d7-477c-b94e-d8ad07852e4e", "content-length": "26", "date": "Thu, 14 Nov 2024 00:30:53 GMT"} })
23422024-11-14T00:30:53.337ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23432024-11-14T00:30:53.338ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23442024-11-14T00:30:53.339ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
23452024-11-14T00:30:53.434ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 278.335156ms iteration = 25 status = {}
23462024-11-14T00:30:53.437ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
23472024-11-14T00:30:53.438ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1d28d40a-5875-4d5b-b22a-f2838e21ff41", "date": "Thu, 14 Nov 2024 00:30:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23482024-11-14T00:30:53.438ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23492024-11-14T00:30:53.441ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "763b4769-1ff9-4e1e-87d5-3f0754d2632d", "date": "Thu, 14 Nov 2024 00:30:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23502024-11-14T00:30:53.441ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23512024-11-14T00:30:53.444ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
23522024-11-14T00:30:53.444ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 288.307627ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
23532024-11-14T00:30:53.445ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
23542024-11-14T00:30:53.445ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23552024-11-14T00:30:53.445ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d97d11a-72d8-4aa3-82c4-0fccd90cd0e1", "content-length": "372", "date": "Thu, 14 Nov 2024 00:30:53 GMT"} })
23562024-11-14T00:30:53.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23572024-11-14T00:30:53.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23582024-11-14T00:30:53.450ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23592024-11-14T00:30:53.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 292.615207ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
23602024-11-14T00:30:53.451ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23612024-11-14T00:30:53.451ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1753, tv_nsec: 168280579 } })
23622024-11-14T00:30:53.453ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 296.882277ms iteration = 6 status = {"nsuccess":5}
23632024-11-14T00:30:53.454ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
23642024-11-14T00:30:53.454ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 297.77271ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23652024-11-14T00:30:53.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23662024-11-14T00:30:53.454ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23672024-11-14T00:30:53.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23682024-11-14T00:30:53.454ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23692024-11-14T00:30:53.455ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23702024-11-14T00:30:53.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23712024-11-14T00:30:53.457ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23722024-11-14T00:30:53.458ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23732024-11-14T00:30:53.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23742024-11-14T00:30:53.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23752024-11-14T00:30:53.458ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
23762024-11-14T00:30:53.459ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ddc2d99-d689-4981-94ea-346a2a3f2a91", "content-length": "2", "date": "Thu, 14 Nov 2024 00:30:52 GMT"} })
23772024-11-14T00:30:53.463ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2249d3ef-e161-463e-bd03-3f37771eab48 dns_zone_name = oxide.test found_so_far = 1 version = 2
23782024-11-14T00:30:53.463ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
23792024-11-14T00:30:53.463ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 00:18:55.211515 UTC dns_group = external generation = 2
23802024-11-14T00:30:53.463ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 306.866487ms iteration = 14 status = {"generation":2}
23812024-11-14T00:30:53.464ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23822024-11-14T00:30:53.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
23832024-11-14T00:30:53.468ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 311.911599ms iteration = 25 status = null
23842024-11-14T00:30:53.476ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
23852024-11-14T00:30:53.476ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 319.714769ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
23862024-11-14T00:30:53.486ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
23872024-11-14T00:30:53.505ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23882024-11-14T00:30:53.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23892024-11-14T00:30:53.507ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23902024-11-14T00:30:53.510ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23912024-11-14T00:30:53.510ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23922024-11-14T00:30:53.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23932024-11-14T00:30:53.514ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23942024-11-14T00:30:53.516ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
23952024-11-14T00:30:53.516ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 501e9987-47e9-4194-a5b0-10ee954fd76c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
23962024-11-14T00:30:53.516ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23972024-11-14T00:30:53.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23982024-11-14T00:30:53.517ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23992024-11-14T00:30:53.517ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24002024-11-14T00:30:53.517ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24012024-11-14T00:30:53.517ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24022024-11-14T00:30:53.517ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 361.00888ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24032024-11-14T00:30:53.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24042024-11-14T00:30:53.519ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24052024-11-14T00:30:53.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24062024-11-14T00:30:53.523ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24072024-11-14T00:30:53.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24082024-11-14T00:30:53.524ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24092024-11-14T00:30:53.524ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
24102024-11-14T00:30:53.524ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
24112024-11-14T00:30:53.524ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "48c1ecac-de8a-49df-b942-8d2d383bd8bc", "date": "Thu, 14 Nov 2024 00:30:53 GMT"} })
24122024-11-14T00:30:53.524ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24132024-11-14T00:30:53.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24142024-11-14T00:30:53.525ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 zone_address = fd00:1122:3344:101::2
24152024-11-14T00:30:53.525ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24162024-11-14T00:30:53.525ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 501e9987-47e9-4194-a5b0-10ee954fd76c dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
24172024-11-14T00:30:53.525ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
24182024-11-14T00:30:53.526ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 00:18:53.692551 UTC dns_group = internal generation = 1
24192024-11-14T00:30:53.526ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 369.425128ms iteration = 14 status = {"generation":1}
24202024-11-14T00:30:53.526ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "38b89716-8d02-4abf-8185-ba159a40323c", "content-length": "26", "date": "Thu, 14 Nov 2024 00:30:53 GMT"} })
24212024-11-14T00:30:53.526ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24222024-11-14T00:30:53.526ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 367.057185ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
24232024-11-14T00:30:53.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e211d163-be78-4663-b73f-baf5e9462a10, lookup_type: ById(e211d163-be78-4663-b73f-baf5e9462a10) } result = Ok(())
24242024-11-14T00:30:53.526ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24252024-11-14T00:30:53.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24262024-11-14T00:30:53.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24272024-11-14T00:30:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24282024-11-14T00:30:53.528ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
24292024-11-14T00:30:53.528ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 372.230288ms iteration = 25 status = 0
24302024-11-14T00:30:53.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24312024-11-14T00:30:53.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24322024-11-14T00:30:53.537ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24332024-11-14T00:30:53.537ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24342024-11-14T00:30:53.537ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f63d23c1-4427-4101-a996-beddd0dd5ca0", "date": "Thu, 14 Nov 2024 00:30:53 GMT"} })
24352024-11-14T00:30:53.539ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 382.656754ms iteration = 29 status = {}
24362024-11-14T00:30:53.553ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T00:18:50.724288Z, time_modified: 2024-11-14T00:18:50.724288Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, db_silo: Silo { identity: SiloIdentity { id: bf9014ac-edb7-4293-a1ff-4004060e0581, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T00:18:55.151722Z, time_modified: 2024-11-14T00:18:55.151722Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, db_silo: Silo { identity: SiloIdentity { id: bf9014ac-edb7-4293-a1ff-4004060e0581, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T00:18:55.151722Z, time_modified: 2024-11-14T00:18:55.151722Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52" }] }) }
24372024-11-14T00:30:53.553ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 396.52033ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bf9014ac-edb7-4293-a1ff-4004060e0581","tls_certs":["0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52"]}},"default_endpoint":{"silo_id":"bf9014ac-edb7-4293-a1ff-4004060e0581","tls_certs":["0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
24382024-11-14T00:30:53.572ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24392024-11-14T00:30:53.572ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "676c53f9-a269-49f4-8a8b-1ea7134cabd0", "date": "Thu, 14 Nov 2024 00:30:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24402024-11-14T00:30:53.572ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24412024-11-14T00:30:53.574ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "36802db4-08b2-47d1-b3f1-18cb347b747f", "date": "Thu, 14 Nov 2024 00:30:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24422024-11-14T00:30:53.574ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24432024-11-14T00:30:53.576ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "81a9ce31-77ad-45a1-989a-ecef767d90fd", "date": "Thu, 14 Nov 2024 00:30:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24442024-11-14T00:30:53.576ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24452024-11-14T00:30:53.577ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24462024-11-14T00:30:53.577ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 421.468451ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24472024-11-14T00:30:53.584ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 427.333723ms iteration = 28 status = {"physical_disks_added":0}
24482024-11-14T00:30:53.588ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
24492024-11-14T00:30:53.588ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 431.39532ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
24502024-11-14T00:30:53.636ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24512024-11-14T00:30:53.636ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ffbd1ba-afe8-41a6-9fe7-fa759c67b3ea", "content-length": "691", "date": "Thu, 14 Nov 2024 00:30:53 GMT"} })
24522024-11-14T00:30:53.636ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24532024-11-14T00:30:53.636ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24542024-11-14T00:30:53.636ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24552024-11-14T00:30:53.637ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 480.493561ms iteration = 27 status = {}
24562024-11-14T00:30:53.650ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24572024-11-14T00:30:53.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24582024-11-14T00:30:53.653ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1b492b5b-8c3a-4e99-9528-5d52a91581c5, rack_id: fcfbb675-622a-4d07-9c7d-02f1c7317864, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b) } rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
24592024-11-14T00:30:53.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24602024-11-14T00:30:53.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24612024-11-14T00:30:53.669ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24622024-11-14T00:30:53.669ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "69595d14-1c54-409f-91aa-0915e96acf0a", "content-length": "134", "date": "Thu, 14 Nov 2024 00:30:52 GMT"} })
24632024-11-14T00:30:53.669ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24642024-11-14T00:30:53.669ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b
24652024-11-14T00:30:53.669ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24662024-11-14T00:30:53.669ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24672024-11-14T00:30:53.669ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24682024-11-14T00:30:53.669ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24692024-11-14T00:30:53.669ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24702024-11-14T00:30:53.669ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24712024-11-14T00:30:53.670ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24722024-11-14T00:30:53.670ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24732024-11-14T00:30:53.670ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
24742024-11-14T00:30:53.670ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24752024-11-14T00:30:53.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24762024-11-14T00:30:53.674ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24772024-11-14T00:30:53.674ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b83e78df-09b6-4229-bdd1-96f7425b7f5d", "content-length": "2", "date": "Thu, 14 Nov 2024 00:30:52 GMT"} })
24782024-11-14T00:30:53.674ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24792024-11-14T00:30:53.675ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef0d808f-110b-43bb-9dc1-e3ce0e2c312c", "content-length": "52", "date": "Thu, 14 Nov 2024 00:30:52 GMT"} })
24802024-11-14T00:30:53.675ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
24812024-11-14T00:30:53.675ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24822024-11-14T00:30:53.802ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2d6ad952-42f2-4c79-bd8a-4b84f85e84ed", "date": "Thu, 14 Nov 2024 00:30:53 GMT"} })
24832024-11-14T00:30:53.802ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch = Switch0
24842024-11-14T00:30:53.802ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24852024-11-14T00:30:53.802ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "332cdea5-dab8-4958-b0bc-06b653e9cd0a", "content-length": "682", "date": "Thu, 14 Nov 2024 00:30:53 GMT"} })
24862024-11-14T00:30:53.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24872024-11-14T00:30:53.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24882024-11-14T00:30:53.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24892024-11-14T00:30:53.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24902024-11-14T00:30:53.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24912024-11-14T00:30:53.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24922024-11-14T00:30:53.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24932024-11-14T00:30:53.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24942024-11-14T00:30:53.819ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 663.183312ms iteration = 25 status = {}
24952024-11-14T00:31:00.948ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2053 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = 8b04dacc-01b8-4fa8-a7a2-6b0320088ca1 response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
24962024-11-14T00:31:03.156ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
24972024-11-14T00:31:03.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24982024-11-14T00:31:03.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24992024-11-14T00:31:03.156ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
25002024-11-14T00:31:03.156ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25012024-11-14T00:31:03.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25022024-11-14T00:31:03.184ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25032024-11-14T00:31:03.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25042024-11-14T00:31:03.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25052024-11-14T00:31:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25062024-11-14T00:31:03.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25072024-11-14T00:31:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25082024-11-14T00:31:03.188ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25092024-11-14T00:31:03.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25102024-11-14T00:31:03.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25112024-11-14T00:31:03.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
25122024-11-14T00:31:03.192ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25132024-11-14T00:31:03.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25142024-11-14T00:31:03.203ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
25152024-11-14T00:31:03.203ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.381147ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
25162024-11-14T00:31:03.212ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.036109ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25172024-11-14T00:31:13.155ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
25182024-11-14T00:31:13.155ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25192024-11-14T00:31:13.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25202024-11-14T00:31:13.157ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
25212024-11-14T00:31:13.157ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25222024-11-14T00:31:13.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25232024-11-14T00:31:13.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25242024-11-14T00:31:13.159ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25252024-11-14T00:31:13.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25262024-11-14T00:31:13.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25272024-11-14T00:31:13.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25282024-11-14T00:31:13.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25292024-11-14T00:31:13.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25302024-11-14T00:31:13.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25312024-11-14T00:31:13.164ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25322024-11-14T00:31:13.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
25332024-11-14T00:31:13.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25342024-11-14T00:31:13.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25352024-11-14T00:31:13.179ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
25362024-11-14T00:31:13.179ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.44533ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
25372024-11-14T00:31:13.188ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.59627ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25382024-11-14T00:31:15.947ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2054 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = 5e86a38e-313a-4c57-b8ba-c958528ec682 response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
25392024-11-14T00:31:23.155ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
25402024-11-14T00:31:23.155ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25412024-11-14T00:31:23.155ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
25422024-11-14T00:31:23.155ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
25432024-11-14T00:31:23.155ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
25442024-11-14T00:31:23.155ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25452024-11-14T00:31:23.156ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
25462024-11-14T00:31:23.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
25472024-11-14T00:31:23.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25482024-11-14T00:31:23.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25492024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
25502024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
25512024-11-14T00:31:23.157ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
25522024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25532024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
25542024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
25552024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
25562024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25572024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25582024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
25592024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25602024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25612024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
25622024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
25632024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25642024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25652024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
25662024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25672024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
25682024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25692024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25702024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25712024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25722024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25732024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25742024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25752024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25762024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25772024-11-14T00:31:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25782024-11-14T00:31:23.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25792024-11-14T00:31:23.158ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
25802024-11-14T00:31:23.158ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
25812024-11-14T00:31:23.158ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25822024-11-14T00:31:23.158ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
25832024-11-14T00:31:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
25842024-11-14T00:31:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25852024-11-14T00:31:23.159ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1782, tv_nsec: 875302976 } })
25862024-11-14T00:31:23.159ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1782, tv_nsec: 875312696 } })
25872024-11-14T00:31:23.159ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
25882024-11-14T00:31:23.159ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
25892024-11-14T00:31:23.160ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
25902024-11-14T00:31:23.160ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25912024-11-14T00:31:23.160ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.365911ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
25922024-11-14T00:31:23.160ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
25932024-11-14T00:31:23.160ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
25942024-11-14T00:31:23.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
25952024-11-14T00:31:23.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25962024-11-14T00:31:23.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25972024-11-14T00:31:23.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25982024-11-14T00:31:23.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25992024-11-14T00:31:23.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26002024-11-14T00:31:23.176ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26012024-11-14T00:31:23.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26022024-11-14T00:31:23.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26032024-11-14T00:31:23.179ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26042024-11-14T00:31:23.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
26052024-11-14T00:31:23.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26062024-11-14T00:31:23.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26072024-11-14T00:31:23.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26082024-11-14T00:31:23.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26092024-11-14T00:31:23.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26102024-11-14T00:31:23.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26112024-11-14T00:31:23.183ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 23.082395ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
26122024-11-14T00:31:23.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26132024-11-14T00:31:23.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26142024-11-14T00:31:23.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26152024-11-14T00:31:23.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26162024-11-14T00:31:23.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26172024-11-14T00:31:23.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
26182024-11-14T00:31:23.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26192024-11-14T00:31:23.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26202024-11-14T00:31:23.192ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26212024-11-14T00:31:23.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26222024-11-14T00:31:23.193ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1782, tv_nsec: 909279754 } })
26232024-11-14T00:31:23.193ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
26242024-11-14T00:31:23.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26252024-11-14T00:31:23.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26262024-11-14T00:31:23.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26272024-11-14T00:31:23.206ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26282024-11-14T00:31:23.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26292024-11-14T00:31:23.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26302024-11-14T00:31:23.208ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26312024-11-14T00:31:23.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
26322024-11-14T00:31:23.212ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26332024-11-14T00:31:23.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26342024-11-14T00:31:23.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26352024-11-14T00:31:23.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26362024-11-14T00:31:23.219ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
26372024-11-14T00:31:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
26382024-11-14T00:31:23.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.681734ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
26392024-11-14T00:31:23.219ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26402024-11-14T00:31:23.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26412024-11-14T00:31:23.221ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.427796ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26422024-11-14T00:31:23.222ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26432024-11-14T00:31:23.225ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
26442024-11-14T00:31:23.225ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
26452024-11-14T00:31:23.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
26462024-11-14T00:31:23.230ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
26472024-11-14T00:31:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
26482024-11-14T00:31:23.231ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26492024-11-14T00:31:23.232ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 73.243331ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26502024-11-14T00:31:23.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26512024-11-14T00:31:23.233ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26522024-11-14T00:31:23.233ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
26532024-11-14T00:31:23.233ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26542024-11-14T00:31:23.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26552024-11-14T00:31:23.233ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
26562024-11-14T00:31:23.233ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.457776ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
26572024-11-14T00:31:23.234ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
26582024-11-14T00:31:23.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
26592024-11-14T00:31:23.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26602024-11-14T00:31:23.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26612024-11-14T00:31:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
26622024-11-14T00:31:23.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26632024-11-14T00:31:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26642024-11-14T00:31:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
26652024-11-14T00:31:23.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
26662024-11-14T00:31:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
26672024-11-14T00:31:23.248ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26682024-11-14T00:31:23.250ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26692024-11-14T00:31:23.250ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26702024-11-14T00:31:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26712024-11-14T00:31:23.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26722024-11-14T00:31:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26732024-11-14T00:31:23.252ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
26742024-11-14T00:31:23.252ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26752024-11-14T00:31:23.252ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d128dae1-131e-46bd-a179-3b92fade53f4", "content-length": "26", "date": "Thu, 14 Nov 2024 00:31:23 GMT"} })
26762024-11-14T00:31:23.252ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26772024-11-14T00:31:23.254ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26782024-11-14T00:31:23.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26792024-11-14T00:31:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26802024-11-14T00:31:23.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26812024-11-14T00:31:23.256ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
26822024-11-14T00:31:23.256ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.124799ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
26832024-11-14T00:31:23.256ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 99.020093ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
26842024-11-14T00:31:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e211d163-be78-4663-b73f-baf5e9462a10, lookup_type: ById(e211d163-be78-4663-b73f-baf5e9462a10) } result = Ok(())
26852024-11-14T00:31:23.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26862024-11-14T00:31:23.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26872024-11-14T00:31:23.261ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 104.124944ms iteration = 26 status = 0
26882024-11-14T00:31:23.269ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
26892024-11-14T00:31:23.269ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26902024-11-14T00:31:23.269ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "211585ab-e3d2-46d3-aaa9-4c1b4d659dd0", "content-length": "26", "date": "Thu, 14 Nov 2024 00:31:23 GMT"} })
26912024-11-14T00:31:23.269ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26922024-11-14T00:31:23.272ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26932024-11-14T00:31:23.274ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
26942024-11-14T00:31:23.274ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
26952024-11-14T00:31:23.274ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
26962024-11-14T00:31:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
26972024-11-14T00:31:23.274ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 114.318218ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26982024-11-14T00:31:23.281ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 124.125626ms iteration = 29 status = {"physical_disks_added":0}
26992024-11-14T00:31:23.295ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 zone_address = fd00:1122:3344:101::2
27002024-11-14T00:31:23.295ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
27012024-11-14T00:31:23.295ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f236e215-e144-4b9c-9131-99a6fe096a2f", "content-length": "26", "date": "Thu, 14 Nov 2024 00:31:23 GMT"} })
27022024-11-14T00:31:23.295ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
27032024-11-14T00:31:23.297ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
27042024-11-14T00:31:23.309ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
27052024-11-14T00:31:23.309ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
27062024-11-14T00:31:23.309ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 152.473385ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
27072024-11-14T00:31:23.401ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
27082024-11-14T00:31:23.401ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fb99841-a46e-4a31-aca0-755e962f91cb", "content-length": "2", "date": "Thu, 14 Nov 2024 00:31:22 GMT"} })
27092024-11-14T00:31:23.403ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27102024-11-14T00:31:23.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27112024-11-14T00:31:23.405ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 249.827156ms iteration = 26 status = null
27122024-11-14T00:31:23.406ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
27132024-11-14T00:31:23.406ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27142024-11-14T00:31:23.406ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4b3836e-4f5f-4487-8289-8ea0f938d1e0", "content-length": "372", "date": "Thu, 14 Nov 2024 00:31:23 GMT"} })
27152024-11-14T00:31:23.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27162024-11-14T00:31:23.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27172024-11-14T00:31:23.462ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 307.001469ms iteration = 26 status = {}
27182024-11-14T00:31:23.464ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
27192024-11-14T00:31:23.465ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0333700d-f73b-4292-8539-25a4df75ee02", "content-length": "691", "date": "Thu, 14 Nov 2024 00:31:23 GMT"} })
27202024-11-14T00:31:23.465ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
27212024-11-14T00:31:23.465ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
27222024-11-14T00:31:23.465ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
27232024-11-14T00:31:23.472ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
27242024-11-14T00:31:23.472ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
27252024-11-14T00:31:23.472ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "075f333f-8a83-47e8-9919-b4870078d6de", "date": "Thu, 14 Nov 2024 00:31:23 GMT"} })
27262024-11-14T00:31:23.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27272024-11-14T00:31:23.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27282024-11-14T00:31:23.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27292024-11-14T00:31:23.475ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 318.837317ms iteration = 28 status = {}
27302024-11-14T00:31:23.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27312024-11-14T00:31:23.479ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27322024-11-14T00:31:23.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27332024-11-14T00:31:23.483ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
27342024-11-14T00:31:23.483ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
27352024-11-14T00:31:23.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27362024-11-14T00:31:23.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27372024-11-14T00:31:23.553ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1b492b5b-8c3a-4e99-9528-5d52a91581c5, rack_id: fcfbb675-622a-4d07-9c7d-02f1c7317864, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b) } rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
27382024-11-14T00:31:23.553ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27392024-11-14T00:31:23.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27402024-11-14T00:31:23.563ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
27412024-11-14T00:31:23.563ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "61612834-ba61-4b4d-aac2-b897e231324c", "content-length": "134", "date": "Thu, 14 Nov 2024 00:31:22 GMT"} })
27422024-11-14T00:31:23.563ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27432024-11-14T00:31:23.563ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b
27442024-11-14T00:31:23.563ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27452024-11-14T00:31:23.563ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27462024-11-14T00:31:23.563ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27472024-11-14T00:31:23.563ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27482024-11-14T00:31:23.563ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27492024-11-14T00:31:23.563ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27502024-11-14T00:31:23.564ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27512024-11-14T00:31:23.564ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27522024-11-14T00:31:23.564ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
27532024-11-14T00:31:23.564ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27542024-11-14T00:31:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27552024-11-14T00:31:23.567ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27562024-11-14T00:31:23.567ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "150e4b6e-33fe-4585-a18c-3f145896d7b3", "content-length": "2", "date": "Thu, 14 Nov 2024 00:31:22 GMT"} })
27572024-11-14T00:31:23.567ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27582024-11-14T00:31:23.567ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "93894217-5066-4ec0-be73-44d85c0ad656", "content-length": "52", "date": "Thu, 14 Nov 2024 00:31:22 GMT"} })
27592024-11-14T00:31:23.567ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
27602024-11-14T00:31:23.567ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27612024-11-14T00:31:23.606ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f640c4c3-8bcb-4b6a-b672-aa41dacf05e4", "date": "Thu, 14 Nov 2024 00:31:23 GMT"} })
27622024-11-14T00:31:23.608ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 451.289361ms iteration = 30 status = {}
27632024-11-14T00:31:23.695ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bce57d18-a7ae-46b5-96b7-98056218f7e3", "date": "Thu, 14 Nov 2024 00:31:23 GMT"} })
27642024-11-14T00:31:23.695ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch = Switch0
27652024-11-14T00:31:23.695ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27662024-11-14T00:31:23.696ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "06b4dc0c-a750-440c-b018-0a83bba1784a", "content-length": "682", "date": "Thu, 14 Nov 2024 00:31:23 GMT"} })
27672024-11-14T00:31:23.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27682024-11-14T00:31:23.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27692024-11-14T00:31:23.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27702024-11-14T00:31:23.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27712024-11-14T00:31:23.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27722024-11-14T00:31:23.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27732024-11-14T00:31:23.705ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27742024-11-14T00:31:23.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27752024-11-14T00:31:23.712ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 555.02436ms iteration = 26 status = {}
27762024-11-14T00:31:26.334ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
27772024-11-14T00:31:26.334ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
27782024-11-14T00:31:26.365ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
27792024-11-14T00:31:26.365ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:47618
27802024-11-14T00:31:26.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:47618 req_id = 41d7b37a-0e65-459a-a29b-22ccf828bfdd roles = RoleSet { roles: {} } uri = /metrics/producers
27812024-11-14T00:31:26.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:47618 req_id = 41d7b37a-0e65-459a-a29b-22ccf828bfdd resource = Database result = Ok(()) uri = /metrics/producers
27822024-11-14T00:31:26.400ZINFOnexus: assigned collector to new producer collector_id = ad042fde-503a-4314-8c8c-afa2f783d145 file = nexus/src/app/oximeter.rs:76 producer_id = b501ed1c-871c-451e-b97c-1d88e152ca13
27832024-11-14T00:31:26.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34844 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:47618 req_id = 41d7b37a-0e65-459a-a29b-22ccf828bfdd response_code = 201 uri = /metrics/producers
27842024-11-14T00:31:26.400ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "41d7b37a-0e65-459a-a29b-22ccf828bfdd", "content-length": "41", "date": "Thu, 14 Nov 2024 00:31:26 GMT"} })
27852024-11-14T00:31:26.402ZDEBGnexus (producer-registration-task): registered with nexus successfully
27862024-11-14T00:31:26.402ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
27872024-11-14T00:31:30.952ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2080 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = 43ff2650-7c54-49c5-8e78-af101a4fbf5c response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
27882024-11-14T00:31:33.156ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
27892024-11-14T00:31:33.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27902024-11-14T00:31:33.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27912024-11-14T00:31:33.158ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
27922024-11-14T00:31:33.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27932024-11-14T00:31:33.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27942024-11-14T00:31:33.159ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27952024-11-14T00:31:33.160ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27962024-11-14T00:31:33.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27972024-11-14T00:31:33.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27982024-11-14T00:31:33.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27992024-11-14T00:31:33.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28002024-11-14T00:31:33.163ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.071742ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28012024-11-14T00:31:33.164ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28022024-11-14T00:31:33.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28032024-11-14T00:31:33.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28042024-11-14T00:31:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
28052024-11-14T00:31:33.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28062024-11-14T00:31:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28072024-11-14T00:31:33.175ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
28082024-11-14T00:31:33.175ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.456334ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
28092024-11-14T00:31:43.156ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
28102024-11-14T00:31:43.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28112024-11-14T00:31:43.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28122024-11-14T00:31:43.157ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
28132024-11-14T00:31:43.157ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28142024-11-14T00:31:43.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28152024-11-14T00:31:43.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28162024-11-14T00:31:43.159ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28172024-11-14T00:31:43.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28182024-11-14T00:31:43.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28192024-11-14T00:31:43.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28202024-11-14T00:31:43.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28212024-11-14T00:31:43.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.366927ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28222024-11-14T00:31:43.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28232024-11-14T00:31:43.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28242024-11-14T00:31:43.163ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28252024-11-14T00:31:43.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
28262024-11-14T00:31:43.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28272024-11-14T00:31:43.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28282024-11-14T00:31:43.173ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
28292024-11-14T00:31:43.173ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.577287ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
28302024-11-14T00:31:45.949ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2457 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = 240833c3-87c1-4f9b-b86d-04c094eb1dc2 response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
28312024-11-14T00:31:50.939ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:39327
28322024-11-14T00:31:50.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39327 req_id = 8eb6e8f8-fe6c-473a-ab92-1b4eee04eab0 roles = RoleSet { roles: {} } uri = /metrics/collectors/ad042fde-503a-4314-8c8c-afa2f783d145/producers?sort_by=id_ascending
28332024-11-14T00:31:50.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39327 req_id = 8eb6e8f8-fe6c-473a-ab92-1b4eee04eab0 resource = Database result = Ok(()) uri = /metrics/collectors/ad042fde-503a-4314-8c8c-afa2f783d145/producers?sort_by=id_ascending
28342024-11-14T00:31:50.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3755 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39327 req_id = 8eb6e8f8-fe6c-473a-ab92-1b4eee04eab0 response_code = 200 uri = /metrics/collectors/ad042fde-503a-4314-8c8c-afa2f783d145/producers?sort_by=id_ascending
28352024-11-14T00:31:50.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39327 req_id = bb17bf8e-542d-42a4-9028-a6744cc16bd1 roles = RoleSet { roles: {} } uri = /metrics/collectors/ad042fde-503a-4314-8c8c-afa2f783d145/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTRiNmQ3YS03ZmM4LTQxMTAtOTdjYS1kNTE5ZTBiYWQ3OWYifX0%3D
28362024-11-14T00:31:50.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39327 req_id = bb17bf8e-542d-42a4-9028-a6744cc16bd1 resource = Database result = Ok(()) uri = /metrics/collectors/ad042fde-503a-4314-8c8c-afa2f783d145/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTRiNmQ3YS03ZmM4LTQxMTAtOTdjYS1kNTE5ZTBiYWQ3OWYifX0%3D
28372024-11-14T00:31:50.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2739 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39327 req_id = bb17bf8e-542d-42a4-9028-a6744cc16bd1 response_code = 200 uri = /metrics/collectors/ad042fde-503a-4314-8c8c-afa2f783d145/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTRiNmQ3YS03ZmM4LTQxMTAtOTdjYS1kNTE5ZTBiYWQ3OWYifX0%3D
28382024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
28392024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
28402024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28412024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
28422024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28432024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
28442024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
28452024-11-14T00:31:53.156ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 00:21:53.156656421 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
28462024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
28472024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
28482024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
28492024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
28502024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
28512024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28522024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
28532024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
28542024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28552024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
28562024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28572024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
28582024-11-14T00:31:53.156ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f
28592024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.37\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f"}
28602024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
28612024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
28622024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28632024-11-14T00:31:53.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28642024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28652024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28662024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28672024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
28682024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
28692024-11-14T00:31:53.157ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28702024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28712024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
28722024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28732024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28742024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28752024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
28762024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28772024-11-14T00:31:53.157ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
28782024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
28792024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28802024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28812024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
28822024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28832024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28842024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
28852024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
28862024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
28872024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
28882024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
28892024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28902024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28912024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28922024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28932024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
28942024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28952024-11-14T00:31:53.157ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6880e62c-aa82-46ed-8fbf-fcd0d42c3184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("df51b222-8234-4074-91c0-cdaaebfaa9a4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("df51b222-8234-4074-91c0-cdaaebfaa9a4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1812, tv_nsec: 873151256 } })
28962024-11-14T00:31:53.157ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1ab1c44d-7d9e-4861-bc1e-704f908d5ccd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("34921995-b6f6-4aad-8964-3692385af9d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("af9e2ff3-0008-44dc-81fb-c799d2026305.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("af9e2ff3-0008-44dc-81fb-c799d2026305.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1812, tv_nsec: 873154736 } })
28972024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28982024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28992024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29002024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29012024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
29022024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29032024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29042024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29052024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29062024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29072024-11-14T00:31:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29082024-11-14T00:31:53.158ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
29092024-11-14T00:31:53.158ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.335729ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
29102024-11-14T00:31:53.158ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
29112024-11-14T00:31:53.158ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.38764ms iteration = 15 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
29122024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
29132024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
29142024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
29152024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29162024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
29172024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
29182024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29192024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
29202024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29212024-11-14T00:31:53.159ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1812, tv_nsec: 875036113 } })
29222024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29232024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29242024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
29252024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29262024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
29272024-11-14T00:31:53.159ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
29282024-11-14T00:31:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29292024-11-14T00:31:53.160ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1812, tv_nsec: 875801223 } })
29302024-11-14T00:31:53.160ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
29312024-11-14T00:31:53.160ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
29322024-11-14T00:31:53.160ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29332024-11-14T00:31:53.160ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29342024-11-14T00:31:53.160ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
29352024-11-14T00:31:53.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29362024-11-14T00:31:53.160ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.910804ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29372024-11-14T00:31:53.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29382024-11-14T00:31:53.161ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29392024-11-14T00:31:53.161ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29402024-11-14T00:31:53.161ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29412024-11-14T00:31:53.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29422024-11-14T00:31:53.162ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29432024-11-14T00:31:53.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29442024-11-14T00:31:53.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29452024-11-14T00:31:53.164ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29462024-11-14T00:31:53.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29472024-11-14T00:31:53.164ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29482024-11-14T00:31:53.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29492024-11-14T00:31:53.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29502024-11-14T00:31:53.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29512024-11-14T00:31:53.169ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 00:21:53.156656421 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
29522024-11-14T00:31:53.169ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.926647ms iteration = 14 status = {"expiration":"2024-11-14T00:21:53.156656421Z","pruned":[]}
29532024-11-14T00:31:53.170ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29542024-11-14T00:31:53.170ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29552024-11-14T00:31:53.170ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29562024-11-14T00:31:53.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29572024-11-14T00:31:53.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29582024-11-14T00:31:53.172ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29592024-11-14T00:31:53.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
29602024-11-14T00:31:53.172ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29612024-11-14T00:31:53.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29622024-11-14T00:31:53.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29632024-11-14T00:31:53.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29642024-11-14T00:31:53.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29652024-11-14T00:31:53.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29662024-11-14T00:31:53.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29672024-11-14T00:31:53.179ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29682024-11-14T00:31:53.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29692024-11-14T00:31:53.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29702024-11-14T00:31:53.182ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.176416ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
29712024-11-14T00:31:53.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29722024-11-14T00:31:53.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29732024-11-14T00:31:53.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29742024-11-14T00:31:53.186ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29752024-11-14T00:31:53.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29762024-11-14T00:31:53.187ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29772024-11-14T00:31:53.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29782024-11-14T00:31:53.193ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29792024-11-14T00:31:53.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29802024-11-14T00:31:53.193ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29812024-11-14T00:31:53.194ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29822024-11-14T00:31:53.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29832024-11-14T00:31:53.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29842024-11-14T00:31:53.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29852024-11-14T00:31:53.203ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29862024-11-14T00:31:53.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29872024-11-14T00:31:53.203ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29882024-11-14T00:31:53.205ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29892024-11-14T00:31:53.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29902024-11-14T00:31:53.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29912024-11-14T00:31:53.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
29922024-11-14T00:31:53.210ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29932024-11-14T00:31:53.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29942024-11-14T00:31:53.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29952024-11-14T00:31:53.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
29962024-11-14T00:31:53.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29972024-11-14T00:31:53.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29982024-11-14T00:31:53.216ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29992024-11-14T00:31:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30002024-11-14T00:31:53.217ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30012024-11-14T00:31:53.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30022024-11-14T00:31:53.219ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30032024-11-14T00:31:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30042024-11-14T00:31:53.222ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30052024-11-14T00:31:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30062024-11-14T00:31:53.222ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30072024-11-14T00:31:53.222ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.351ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30082024-11-14T00:31:53.231ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30092024-11-14T00:31:53.231ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30102024-11-14T00:31:53.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30112024-11-14T00:31:53.233ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
30122024-11-14T00:31:53.233ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
30132024-11-14T00:31:53.233ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.830199ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
30142024-11-14T00:31:53.233ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30152024-11-14T00:31:53.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30162024-11-14T00:31:53.234ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30172024-11-14T00:31:53.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
30182024-11-14T00:31:53.234ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30192024-11-14T00:31:53.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.492852ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
30202024-11-14T00:31:53.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30212024-11-14T00:31:53.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30222024-11-14T00:31:53.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30232024-11-14T00:31:53.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30242024-11-14T00:31:53.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30252024-11-14T00:31:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30262024-11-14T00:31:53.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 87.231717ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
30272024-11-14T00:31:53.248ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
30282024-11-14T00:31:53.248ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
30292024-11-14T00:31:53.248ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 90.9669ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
30302024-11-14T00:31:53.248ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30312024-11-14T00:31:53.249ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30322024-11-14T00:31:53.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30332024-11-14T00:31:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30342024-11-14T00:31:53.250ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
30352024-11-14T00:31:53.250ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
30362024-11-14T00:31:53.250ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
30372024-11-14T00:31:53.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30382024-11-14T00:31:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30392024-11-14T00:31:53.271ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
30402024-11-14T00:31:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
30412024-11-14T00:31:53.280ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
30422024-11-14T00:31:53.280ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
30432024-11-14T00:31:53.280ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
30442024-11-14T00:31:53.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30452024-11-14T00:31:53.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30462024-11-14T00:31:53.318ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
30472024-11-14T00:31:53.318ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30482024-11-14T00:31:53.318ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "344044a9-2c1c-4774-857b-2307e9798c54", "content-length": "26", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} })
30492024-11-14T00:31:53.318ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30502024-11-14T00:31:53.320ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30512024-11-14T00:31:53.321ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
30522024-11-14T00:31:53.323ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30532024-11-14T00:31:53.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30542024-11-14T00:31:53.349ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30552024-11-14T00:31:53.349ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30562024-11-14T00:31:53.350ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "89f5c2f1-0b98-4b01-91df-68c5ea30c98b", "content-length": "372", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} })
30572024-11-14T00:31:53.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30582024-11-14T00:31:53.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30592024-11-14T00:31:53.352ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30602024-11-14T00:31:53.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
30612024-11-14T00:31:53.354ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30622024-11-14T00:31:53.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30632024-11-14T00:31:53.360ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1813, tv_nsec: 76136952 } })
30642024-11-14T00:31:53.360ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
30652024-11-14T00:31:53.363ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30662024-11-14T00:31:53.363ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30672024-11-14T00:31:53.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30682024-11-14T00:31:53.365ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30692024-11-14T00:31:53.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30702024-11-14T00:31:53.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30712024-11-14T00:31:53.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30722024-11-14T00:31:53.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e211d163-be78-4663-b73f-baf5e9462a10, lookup_type: ById(e211d163-be78-4663-b73f-baf5e9462a10) } result = Ok(())
30732024-11-14T00:31:53.369ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30742024-11-14T00:31:53.369ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
30752024-11-14T00:31:53.369ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 213.046528ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
30762024-11-14T00:31:53.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30772024-11-14T00:31:53.376ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 219.185715ms iteration = 27 status = 0
30782024-11-14T00:31:53.392ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 235.461783ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30792024-11-14T00:31:53.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 234.848214ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30802024-11-14T00:31:53.396ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30812024-11-14T00:31:53.396ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30822024-11-14T00:31:53.396ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 239.311977ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30832024-11-14T00:31:53.397ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 238.309743ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30842024-11-14T00:31:53.398ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 241.436047ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30852024-11-14T00:31:53.401ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
30862024-11-14T00:31:53.401ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2249d3ef-e161-463e-bd03-3f37771eab48 dns_zone_name = oxide.test found_so_far = 0 version = 2
30872024-11-14T00:31:53.401ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30882024-11-14T00:31:53.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30892024-11-14T00:31:53.403ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30902024-11-14T00:31:53.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30912024-11-14T00:31:53.407ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30922024-11-14T00:31:53.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30932024-11-14T00:31:53.416ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
30942024-11-14T00:31:53.422ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T00:18:50.724288Z, time_modified: 2024-11-14T00:18:50.724288Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, db_silo: Silo { identity: SiloIdentity { id: bf9014ac-edb7-4293-a1ff-4004060e0581, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T00:18:55.151722Z, time_modified: 2024-11-14T00:18:55.151722Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, db_silo: Silo { identity: SiloIdentity { id: bf9014ac-edb7-4293-a1ff-4004060e0581, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T00:18:55.151722Z, time_modified: 2024-11-14T00:18:55.151722Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52" }] }) }
30952024-11-14T00:31:53.422ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 266.147745ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bf9014ac-edb7-4293-a1ff-4004060e0581","tls_certs":["0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52"]}},"default_endpoint":{"silo_id":"bf9014ac-edb7-4293-a1ff-4004060e0581","tls_certs":["0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
30962024-11-14T00:31:53.428ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
30972024-11-14T00:31:53.429ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30982024-11-14T00:31:53.429ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "395576a9-36e2-4ea8-8099-e213abfaa459", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} })
30992024-11-14T00:31:53.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31002024-11-14T00:31:53.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31012024-11-14T00:31:53.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31022024-11-14T00:31:53.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31032024-11-14T00:31:53.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31042024-11-14T00:31:53.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31052024-11-14T00:31:53.443ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
31062024-11-14T00:31:53.443ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31072024-11-14T00:31:53.444ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "de773eb7-8fac-45c3-bec5-f3a737f123d1", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} })
31082024-11-14T00:31:53.446ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
31092024-11-14T00:31:53.446ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31102024-11-14T00:31:53.447ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd1dc679-ca75-4526-90da-8b2f3012576c", "content-length": "26", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} })
31112024-11-14T00:31:53.447ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31122024-11-14T00:31:53.447ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 290.093431ms iteration = 31 status = {}
31132024-11-14T00:31:53.449ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31142024-11-14T00:31:53.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31152024-11-14T00:31:53.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31162024-11-14T00:31:53.466ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31172024-11-14T00:31:53.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31182024-11-14T00:31:53.470ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
31192024-11-14T00:31:53.470ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 501e9987-47e9-4194-a5b0-10ee954fd76c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
31202024-11-14T00:31:53.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31212024-11-14T00:31:53.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31222024-11-14T00:31:53.472ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2249d3ef-e161-463e-bd03-3f37771eab48 dns_zone_name = oxide.test found_so_far = 1 version = 2
31232024-11-14T00:31:53.472ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
31242024-11-14T00:31:53.472ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 00:18:55.211515 UTC dns_group = external generation = 2
31252024-11-14T00:31:53.472ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 315.593751ms iteration = 15 status = {"generation":2}
31262024-11-14T00:31:53.480ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 323.458172ms iteration = 27 status = {}
31272024-11-14T00:31:53.481ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
31282024-11-14T00:31:53.499ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 zone_address = fd00:1122:3344:101::2
31292024-11-14T00:31:53.499ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31302024-11-14T00:31:53.513ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31312024-11-14T00:31:53.514ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
31322024-11-14T00:31:53.514ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 356.72591ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
31332024-11-14T00:31:53.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
31342024-11-14T00:31:53.516ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31352024-11-14T00:31:53.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31362024-11-14T00:31:53.519ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 362.585602ms iteration = 30 status = {"physical_disks_added":0}
31372024-11-14T00:31:53.520ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 501e9987-47e9-4194-a5b0-10ee954fd76c dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
31382024-11-14T00:31:53.520ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
31392024-11-14T00:31:53.520ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 00:18:53.692551 UTC dns_group = internal generation = 1
31402024-11-14T00:31:53.520ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:36255
31412024-11-14T00:31:53.520ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 363.529475ms iteration = 15 status = {"generation":1}
31422024-11-14T00:31:53.520ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5070e745-57b4-490e-8cf6-ce161156e1d3", "content-length": "26", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} })
31432024-11-14T00:31:53.520ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31442024-11-14T00:31:53.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36255 req_id = 7bcbc3e3-4fa9-4998-b0f4-facaadd4ad26 roles = RoleSet { roles: {} } uri = /metrics/producers
31452024-11-14T00:31:53.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36255 req_id = 7bcbc3e3-4fa9-4998-b0f4-facaadd4ad26 resource = Database result = Ok(()) uri = /metrics/producers
31462024-11-14T00:31:53.521ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31472024-11-14T00:31:53.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31482024-11-14T00:31:53.522ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
31492024-11-14T00:31:53.524ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31502024-11-14T00:31:53.526ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31512024-11-14T00:31:53.526ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31522024-11-14T00:31:53.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31532024-11-14T00:31:53.546ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
31542024-11-14T00:31:53.547ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ed1abdb8-fb03-44a7-96e4-0316cbceea38", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31552024-11-14T00:31:53.547ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31562024-11-14T00:31:53.548ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d3f0a367-d43f-4454-a35a-001d8fe9972d", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31572024-11-14T00:31:53.548ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31582024-11-14T00:31:53.550ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
31592024-11-14T00:31:53.550ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 393.939524ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
31602024-11-14T00:31:53.557ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31612024-11-14T00:31:53.559ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31622024-11-14T00:31:53.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31632024-11-14T00:31:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31642024-11-14T00:31:53.561ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31652024-11-14T00:31:53.561ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "79afc566-3fd1-4915-89e8-b20eeef64a47", "content-length": "2", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} })
31662024-11-14T00:31:53.562ZINFOnexus: assigned collector to new producer collector_id = ad042fde-503a-4314-8c8c-afa2f783d145 file = nexus/src/app/oximeter.rs:76 producer_id = 0867195b-1633-40b0-a3a6-a61f7ba60ba6
31672024-11-14T00:31:53.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 42270 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36255 req_id = 7bcbc3e3-4fa9-4998-b0f4-facaadd4ad26 response_code = 201 uri = /metrics/producers
31682024-11-14T00:31:53.563ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31692024-11-14T00:31:53.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31702024-11-14T00:31:53.566ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 410.100131ms iteration = 27 status = null
31712024-11-14T00:31:53.586ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
31722024-11-14T00:31:53.587ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "587cb8a3-2bb5-44b3-a14f-44273635a4be", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31732024-11-14T00:31:53.587ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31742024-11-14T00:31:53.589ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d7889be1-4850-4c79-be1c-7ddc65a37b3a", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31752024-11-14T00:31:53.589ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31762024-11-14T00:31:53.591ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b426874b-6613-463c-bedd-07ccfd639d91", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31772024-11-14T00:31:53.591ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31782024-11-14T00:31:53.593ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31792024-11-14T00:31:53.593ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 437.178682ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
31802024-11-14T00:31:53.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31812024-11-14T00:31:53.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31822024-11-14T00:31:53.685ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1b492b5b-8c3a-4e99-9528-5d52a91581c5, rack_id: fcfbb675-622a-4d07-9c7d-02f1c7317864, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b) } rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
31832024-11-14T00:31:53.685ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31842024-11-14T00:31:53.685ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31852024-11-14T00:31:53.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31862024-11-14T00:31:53.685ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c21cc611-4263-449f-b0f0-6d301cb80027", "content-length": "691", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} })
31872024-11-14T00:31:53.685ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
31882024-11-14T00:31:53.685ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
31892024-11-14T00:31:53.685ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
31902024-11-14T00:31:53.687ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 529.816695ms iteration = 29 status = {}
31912024-11-14T00:31:53.694ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
31922024-11-14T00:31:53.695ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f0503a5-7f2c-4dc6-b833-3a70adba6814", "content-length": "134", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} })
31932024-11-14T00:31:53.695ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
31942024-11-14T00:31:53.695ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b
31952024-11-14T00:31:53.695ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
31962024-11-14T00:31:53.695ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31972024-11-14T00:31:53.695ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31982024-11-14T00:31:53.695ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31992024-11-14T00:31:53.695ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32002024-11-14T00:31:53.695ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32012024-11-14T00:31:53.695ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
32022024-11-14T00:31:53.695ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
32032024-11-14T00:31:53.695ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
32042024-11-14T00:31:53.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32052024-11-14T00:31:53.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32062024-11-14T00:31:53.698ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32072024-11-14T00:31:53.698ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a6efdff-eaa8-4530-9b6d-b82821441c7e", "content-length": "2", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} })
32082024-11-14T00:31:53.698ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32092024-11-14T00:31:53.698ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d9d1092-d91c-48c5-9aea-ce2d53676d0f", "content-length": "52", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} })
32102024-11-14T00:31:53.698ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
32112024-11-14T00:31:53.698ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32122024-11-14T00:31:53.806ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8fbf7373-06fa-420a-b27d-c27ade22b5b1", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} })
32132024-11-14T00:31:53.806ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch = Switch0
32142024-11-14T00:31:53.806ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32152024-11-14T00:31:53.806ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "892abb3b-3761-4a57-ae04-c00d8c05de83", "content-length": "682", "date": "Thu, 14 Nov 2024 00:31:53 GMT"} })
32162024-11-14T00:31:53.806ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32172024-11-14T00:31:53.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32182024-11-14T00:31:53.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32192024-11-14T00:31:53.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32202024-11-14T00:31:53.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32212024-11-14T00:31:53.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32222024-11-14T00:31:53.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32232024-11-14T00:31:53.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32242024-11-14T00:31:53.827ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 670.14311ms iteration = 27 status = {}
32252024-11-14T00:32:00.949ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2601 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = 3413ea80-6b3c-4e5f-9825-f57feed02b42 response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
32262024-11-14T00:32:00.950ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:47271
32272024-11-14T00:32:00.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47271 req_id = 04afda09-418b-42df-a547-05bfa0dd57ab roles = RoleSet { roles: {} } uri = /metrics/producers
32282024-11-14T00:32:00.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47271 req_id = 04afda09-418b-42df-a547-05bfa0dd57ab resource = Database result = Ok(()) uri = /metrics/producers
32292024-11-14T00:32:00.989ZINFOnexus: assigned collector to new producer collector_id = ad042fde-503a-4314-8c8c-afa2f783d145 file = nexus/src/app/oximeter.rs:76 producer_id = fa4b6d7a-7fc8-4110-97ca-d519e0bad79f
32302024-11-14T00:32:00.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39511 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47271 req_id = 04afda09-418b-42df-a547-05bfa0dd57ab response_code = 201 uri = /metrics/producers
32312024-11-14T00:32:01.609ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::1]:53461
32322024-11-14T00:32:01.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53461 req_id = 3d203f7d-4a56-4ef2-a50c-20db79e578de roles = RoleSet { roles: {} } uri = /metrics/producers
32332024-11-14T00:32:01.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53461 req_id = 3d203f7d-4a56-4ef2-a50c-20db79e578de resource = Database result = Ok(()) uri = /metrics/producers
32342024-11-14T00:32:01.645ZINFOnexus: assigned collector to new producer collector_id = ad042fde-503a-4314-8c8c-afa2f783d145 file = nexus/src/app/oximeter.rs:76 producer_id = afab1673-32bd-45f4-b7b4-2fb0dd07b883
32352024-11-14T00:32:01.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35477 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:53461 req_id = 3d203f7d-4a56-4ef2-a50c-20db79e578de response_code = 201 uri = /metrics/producers
32362024-11-14T00:32:03.156ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
32372024-11-14T00:32:03.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32382024-11-14T00:32:03.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32392024-11-14T00:32:03.157ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
32402024-11-14T00:32:03.157ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32412024-11-14T00:32:03.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32422024-11-14T00:32:03.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32432024-11-14T00:32:03.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32442024-11-14T00:32:03.161ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32452024-11-14T00:32:03.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32462024-11-14T00:32:03.163ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32472024-11-14T00:32:03.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32482024-11-14T00:32:03.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32492024-11-14T00:32:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
32502024-11-14T00:32:03.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32512024-11-14T00:32:03.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32522024-11-14T00:32:03.179ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
32532024-11-14T00:32:03.179ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.172946ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
32542024-11-14T00:32:03.186ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32552024-11-14T00:32:03.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32562024-11-14T00:32:03.220ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.657151ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32572024-11-14T00:32:03.566ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:48033
32582024-11-14T00:32:03.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48033 req_id = 95de22f7-cfb9-4277-8f1a-923ae6f8543e roles = RoleSet { roles: {} } uri = /metrics/producers
32592024-11-14T00:32:03.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48033 req_id = 95de22f7-cfb9-4277-8f1a-923ae6f8543e resource = Database result = Ok(()) uri = /metrics/producers
32602024-11-14T00:32:03.575ZINFOnexus: assigned collector to new producer collector_id = ad042fde-503a-4314-8c8c-afa2f783d145 file = nexus/src/app/oximeter.rs:76 producer_id = c8479a7e-453b-4726-aa7e-02c02e8ddff2
32612024-11-14T00:32:03.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8898 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48033 req_id = 95de22f7-cfb9-4277-8f1a-923ae6f8543e response_code = 201 uri = /metrics/producers
32622024-11-14T00:32:13.156ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
32632024-11-14T00:32:13.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32642024-11-14T00:32:13.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32652024-11-14T00:32:13.157ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
32662024-11-14T00:32:13.157ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32672024-11-14T00:32:13.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32682024-11-14T00:32:13.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32692024-11-14T00:32:13.191ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32702024-11-14T00:32:13.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32712024-11-14T00:32:13.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32722024-11-14T00:32:13.192ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32732024-11-14T00:32:13.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32742024-11-14T00:32:13.195ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32752024-11-14T00:32:13.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32762024-11-14T00:32:13.196ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32772024-11-14T00:32:13.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
32782024-11-14T00:32:13.198ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32792024-11-14T00:32:13.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32802024-11-14T00:32:13.213ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
32812024-11-14T00:32:13.213ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.374424ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
32822024-11-14T00:32:13.225ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.986787ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32832024-11-14T00:32:15.948ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2451 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = 70def02a-8262-4283-a847-3cf8cac6d7dc response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
32842024-11-14T00:32:23.156ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
32852024-11-14T00:32:23.156ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32862024-11-14T00:32:23.156ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
32872024-11-14T00:32:23.156ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
32882024-11-14T00:32:23.156ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
32892024-11-14T00:32:23.156ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32902024-11-14T00:32:23.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32912024-11-14T00:32:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32922024-11-14T00:32:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
32932024-11-14T00:32:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
32942024-11-14T00:32:23.157ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
32952024-11-14T00:32:23.157ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32962024-11-14T00:32:23.157ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
32972024-11-14T00:32:23.157ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32982024-11-14T00:32:23.157ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32992024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33002024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
33012024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33022024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33032024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
33042024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33052024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33062024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
33072024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33082024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33092024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
33102024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33112024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33122024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33132024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
33142024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33152024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33162024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
33172024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33182024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
33192024-11-14T00:32:23.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33202024-11-14T00:32:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33212024-11-14T00:32:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33222024-11-14T00:32:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33232024-11-14T00:32:23.160ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
33242024-11-14T00:32:23.160ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
33252024-11-14T00:32:23.160ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33262024-11-14T00:32:23.160ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33272024-11-14T00:32:23.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33282024-11-14T00:32:23.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33292024-11-14T00:32:23.161ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
33302024-11-14T00:32:23.161ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33312024-11-14T00:32:23.161ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
33322024-11-14T00:32:23.161ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33332024-11-14T00:32:23.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33342024-11-14T00:32:23.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33352024-11-14T00:32:23.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33362024-11-14T00:32:23.162ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1842, tv_nsec: 877757631 } })
33372024-11-14T00:32:23.162ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
33382024-11-14T00:32:23.164ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1842, tv_nsec: 879723099 } })
33392024-11-14T00:32:23.164ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.945751ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33402024-11-14T00:32:23.164ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
33412024-11-14T00:32:23.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33422024-11-14T00:32:23.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33432024-11-14T00:32:23.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33442024-11-14T00:32:23.167ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33452024-11-14T00:32:23.169ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33462024-11-14T00:32:23.169ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33472024-11-14T00:32:23.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33482024-11-14T00:32:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33492024-11-14T00:32:23.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
33502024-11-14T00:32:23.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33512024-11-14T00:32:23.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33522024-11-14T00:32:23.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33532024-11-14T00:32:23.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33542024-11-14T00:32:23.173ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33552024-11-14T00:32:23.173ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
33562024-11-14T00:32:23.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33572024-11-14T00:32:23.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33582024-11-14T00:32:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33592024-11-14T00:32:23.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33602024-11-14T00:32:23.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33612024-11-14T00:32:23.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33622024-11-14T00:32:23.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
33632024-11-14T00:32:23.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33642024-11-14T00:32:23.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33652024-11-14T00:32:23.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33662024-11-14T00:32:23.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33672024-11-14T00:32:23.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33682024-11-14T00:32:23.186ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33692024-11-14T00:32:23.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33702024-11-14T00:32:23.187ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1842, tv_nsec: 902646151 } })
33712024-11-14T00:32:23.187ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
33722024-11-14T00:32:23.189ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33732024-11-14T00:32:23.189ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 30.924955ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33742024-11-14T00:32:23.191ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33752024-11-14T00:32:23.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
33762024-11-14T00:32:23.195ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33772024-11-14T00:32:23.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33782024-11-14T00:32:23.218ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
33792024-11-14T00:32:23.218ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.360394ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
33802024-11-14T00:32:23.219ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33812024-11-14T00:32:23.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33822024-11-14T00:32:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33832024-11-14T00:32:23.221ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33842024-11-14T00:32:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33852024-11-14T00:32:23.222ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.712962ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
33862024-11-14T00:32:23.223ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33872024-11-14T00:32:23.224ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33882024-11-14T00:32:23.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33892024-11-14T00:32:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33902024-11-14T00:32:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33912024-11-14T00:32:23.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33922024-11-14T00:32:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33932024-11-14T00:32:23.224ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33942024-11-14T00:32:23.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33952024-11-14T00:32:23.226ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.839359ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33962024-11-14T00:32:23.226ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33972024-11-14T00:32:23.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 67.590061ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
33982024-11-14T00:32:23.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33992024-11-14T00:32:23.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34002024-11-14T00:32:23.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34012024-11-14T00:32:23.229ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34022024-11-14T00:32:23.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34032024-11-14T00:32:23.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34042024-11-14T00:32:23.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34052024-11-14T00:32:23.235ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.007791ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
34062024-11-14T00:32:23.237ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34072024-11-14T00:32:23.237ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
34082024-11-14T00:32:23.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34092024-11-14T00:32:23.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34102024-11-14T00:32:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34112024-11-14T00:32:23.237ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 78.653086ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34122024-11-14T00:32:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34132024-11-14T00:32:23.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34142024-11-14T00:32:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34152024-11-14T00:32:23.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34162024-11-14T00:32:23.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 79.793262ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
34172024-11-14T00:32:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e211d163-be78-4663-b73f-baf5e9462a10, lookup_type: ById(e211d163-be78-4663-b73f-baf5e9462a10) } result = Ok(())
34182024-11-14T00:32:23.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34192024-11-14T00:32:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34202024-11-14T00:32:23.246ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.637813ms iteration = 28 status = 0
34212024-11-14T00:32:23.265ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
34222024-11-14T00:32:23.266ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34232024-11-14T00:32:23.266ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "73f28bb9-8ae3-42bd-901e-5634da5d4c36", "content-length": "26", "date": "Thu, 14 Nov 2024 00:32:23 GMT"} })
34242024-11-14T00:32:23.266ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34252024-11-14T00:32:23.268ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34262024-11-14T00:32:23.272ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
34272024-11-14T00:32:23.272ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34282024-11-14T00:32:23.272ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ead0b6e-70fe-40e6-8033-18810a47264e", "content-length": "26", "date": "Thu, 14 Nov 2024 00:32:23 GMT"} })
34292024-11-14T00:32:23.272ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34302024-11-14T00:32:23.275ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34312024-11-14T00:32:23.281ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34322024-11-14T00:32:23.281ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34332024-11-14T00:32:23.281ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.812997ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34342024-11-14T00:32:23.289ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 zone_address = fd00:1122:3344:101::2
34352024-11-14T00:32:23.289ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34362024-11-14T00:32:23.290ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f4a0d7c-bf5b-460d-b5c0-7b2232ad51a6", "content-length": "26", "date": "Thu, 14 Nov 2024 00:32:23 GMT"} })
34372024-11-14T00:32:23.290ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34382024-11-14T00:32:23.291ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
34392024-11-14T00:32:23.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34402024-11-14T00:32:23.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34412024-11-14T00:32:23.333ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34422024-11-14T00:32:23.333ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34432024-11-14T00:32:23.334ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "96c5821e-540a-46eb-a64a-ad3303b8e9e1", "content-length": "372", "date": "Thu, 14 Nov 2024 00:32:23 GMT"} })
34442024-11-14T00:32:23.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34452024-11-14T00:32:23.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34462024-11-14T00:32:23.349ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
34472024-11-14T00:32:23.349ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34482024-11-14T00:32:23.349ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4e2317fc-6796-4599-8c23-b3ac0454800a", "date": "Thu, 14 Nov 2024 00:32:23 GMT"} })
34492024-11-14T00:32:23.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34502024-11-14T00:32:23.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34512024-11-14T00:32:23.349ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 191.618216ms iteration = 31 status = {"physical_disks_added":0}
34522024-11-14T00:32:23.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34532024-11-14T00:32:23.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34542024-11-14T00:32:23.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34552024-11-14T00:32:23.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34562024-11-14T00:32:23.358ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
34572024-11-14T00:32:23.358ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34582024-11-14T00:32:23.358ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d0a0bb13-8499-4f13-8afc-853d0822634d", "date": "Thu, 14 Nov 2024 00:32:23 GMT"} })
34592024-11-14T00:32:23.360ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 203.192719ms iteration = 32 status = {}
34602024-11-14T00:32:23.368ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 211.77806ms iteration = 28 status = {}
34612024-11-14T00:32:23.371ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34622024-11-14T00:32:23.371ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "30f519dd-3631-4526-8f85-41ab360be8fd", "content-length": "2", "date": "Thu, 14 Nov 2024 00:32:22 GMT"} })
34632024-11-14T00:32:23.373ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34642024-11-14T00:32:23.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34652024-11-14T00:32:23.375ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 219.067172ms iteration = 28 status = null
34662024-11-14T00:32:23.406ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34672024-11-14T00:32:23.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34682024-11-14T00:32:23.407ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34692024-11-14T00:32:23.409ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34702024-11-14T00:32:23.409ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34712024-11-14T00:32:23.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34722024-11-14T00:32:23.411ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34732024-11-14T00:32:23.413ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34742024-11-14T00:32:23.413ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34752024-11-14T00:32:23.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34762024-11-14T00:32:23.542ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34772024-11-14T00:32:23.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34782024-11-14T00:32:23.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34792024-11-14T00:32:23.552ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1b492b5b-8c3a-4e99-9528-5d52a91581c5, rack_id: fcfbb675-622a-4d07-9c7d-02f1c7317864, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b) } rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
34802024-11-14T00:32:23.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34812024-11-14T00:32:23.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34822024-11-14T00:32:23.562ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
34832024-11-14T00:32:23.562ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "21778190-f779-43f8-a0d2-a6f5ddecd267", "content-length": "134", "date": "Thu, 14 Nov 2024 00:32:22 GMT"} })
34842024-11-14T00:32:23.562ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
34852024-11-14T00:32:23.562ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b
34862024-11-14T00:32:23.563ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
34872024-11-14T00:32:23.563ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34882024-11-14T00:32:23.563ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34892024-11-14T00:32:23.563ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34902024-11-14T00:32:23.563ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34912024-11-14T00:32:23.563ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34922024-11-14T00:32:23.563ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34932024-11-14T00:32:23.563ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34942024-11-14T00:32:23.563ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
34952024-11-14T00:32:23.563ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34962024-11-14T00:32:23.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34972024-11-14T00:32:23.566ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
34982024-11-14T00:32:23.566ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "60fb9d57-26c9-4967-a5f2-b243ccc6fd23", "content-length": "2", "date": "Thu, 14 Nov 2024 00:32:22 GMT"} })
34992024-11-14T00:32:23.566ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35002024-11-14T00:32:23.566ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "39923f37-553a-4d78-8285-aeacea5dd98b", "content-length": "52", "date": "Thu, 14 Nov 2024 00:32:22 GMT"} })
35012024-11-14T00:32:23.566ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
35022024-11-14T00:32:23.566ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35032024-11-14T00:32:23.637ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0442cff5-bcde-487d-b9d0-8a7d55cf28d5", "content-length": "691", "date": "Thu, 14 Nov 2024 00:32:23 GMT"} })
35042024-11-14T00:32:23.637ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
35052024-11-14T00:32:23.637ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
35062024-11-14T00:32:23.637ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
35072024-11-14T00:32:23.638ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 479.873802ms iteration = 30 status = {}
35082024-11-14T00:32:23.743ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ed9cd3f5-c916-4411-8d39-98245e437ed1", "date": "Thu, 14 Nov 2024 00:32:23 GMT"} })
35092024-11-14T00:32:23.743ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch = Switch0
35102024-11-14T00:32:23.743ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35112024-11-14T00:32:23.749ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a70f25f-cc1a-4ec2-8fd0-b66757c2cbd6", "content-length": "682", "date": "Thu, 14 Nov 2024 00:32:23 GMT"} })
35122024-11-14T00:32:23.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35132024-11-14T00:32:23.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35142024-11-14T00:32:23.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35152024-11-14T00:32:23.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35162024-11-14T00:32:23.756ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35172024-11-14T00:32:23.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35182024-11-14T00:32:23.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35192024-11-14T00:32:23.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35202024-11-14T00:32:23.765ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 606.431313ms iteration = 28 status = {}
35212024-11-14T00:32:28.105ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::1]:63496
35222024-11-14T00:32:28.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63496 req_id = 61d78ed6-794e-4835-b142-8e1a4dc6eab7 roles = RoleSet { roles: {} } uri = /metrics/producers
35232024-11-14T00:32:28.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63496 req_id = 61d78ed6-794e-4835-b142-8e1a4dc6eab7 resource = Database result = Ok(()) uri = /metrics/producers
35242024-11-14T00:32:28.117ZINFOnexus: assigned collector to new producer collector_id = ad042fde-503a-4314-8c8c-afa2f783d145 file = nexus/src/app/oximeter.rs:76 producer_id = e211d163-be78-4663-b73f-baf5e9462a10
35252024-11-14T00:32:28.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11754 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63496 req_id = 61d78ed6-794e-4835-b142-8e1a4dc6eab7 response_code = 201 uri = /metrics/producers
35262024-11-14T00:32:30.155ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:60078
35272024-11-14T00:32:30.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60078 req_id = 24464909-93eb-4247-9a60-45a1a9ed8b43 roles = RoleSet { roles: {} } uri = /metrics/producers
35282024-11-14T00:32:30.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60078 req_id = 24464909-93eb-4247-9a60-45a1a9ed8b43 resource = Database result = Ok(()) uri = /metrics/producers
35292024-11-14T00:32:30.193ZINFOnexus: assigned collector to new producer collector_id = ad042fde-503a-4314-8c8c-afa2f783d145 file = nexus/src/app/oximeter.rs:76 producer_id = 37a8017a-7671-48c4-9532-2ad79f4cbd2e
35302024-11-14T00:32:30.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38291 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60078 req_id = 24464909-93eb-4247-9a60-45a1a9ed8b43 response_code = 201 uri = /metrics/producers
35312024-11-14T00:32:30.950ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2949 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = d034810e-897b-4977-82c8-5f5f238f64ea response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
35322024-11-14T00:32:33.157ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
35332024-11-14T00:32:33.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35342024-11-14T00:32:33.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35352024-11-14T00:32:33.158ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
35362024-11-14T00:32:33.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35372024-11-14T00:32:33.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35382024-11-14T00:32:33.159ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35392024-11-14T00:32:33.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35402024-11-14T00:32:33.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35412024-11-14T00:32:33.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35422024-11-14T00:32:33.164ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35432024-11-14T00:32:33.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35442024-11-14T00:32:33.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35452024-11-14T00:32:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
35462024-11-14T00:32:33.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35472024-11-14T00:32:33.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35482024-11-14T00:32:33.176ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
35492024-11-14T00:32:33.176ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.270152ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
35502024-11-14T00:32:33.186ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35512024-11-14T00:32:33.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35522024-11-14T00:32:33.188ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.436079ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35532024-11-14T00:32:43.157ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
35542024-11-14T00:32:43.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35552024-11-14T00:32:43.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35562024-11-14T00:32:43.157ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
35572024-11-14T00:32:43.157ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35582024-11-14T00:32:43.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35592024-11-14T00:32:43.159ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35602024-11-14T00:32:43.159ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35612024-11-14T00:32:43.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35622024-11-14T00:32:43.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.214615ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35632024-11-14T00:32:43.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35642024-11-14T00:32:43.161ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35652024-11-14T00:32:43.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35662024-11-14T00:32:43.163ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35672024-11-14T00:32:43.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35682024-11-14T00:32:43.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35692024-11-14T00:32:43.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
35702024-11-14T00:32:43.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35712024-11-14T00:32:43.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35722024-11-14T00:32:43.176ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
35732024-11-14T00:32:43.176ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.999838ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
35742024-11-14T00:32:45.948ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2180 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = 1c26c2a5-f26a-48cb-a404-31fa73df801e response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
35752024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
35762024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
35772024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
35782024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
35792024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
35802024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35812024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
35822024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35832024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
35842024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35852024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
35862024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
35872024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35882024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
35892024-11-14T00:32:53.157ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 00:22:53.157382750 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
35902024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
35912024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
35922024-11-14T00:32:53.157ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f
35932024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
35942024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.88\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f"}
35952024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35962024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
35972024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
35982024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
35992024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36002024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36012024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36022024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36032024-11-14T00:32:53.157ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6880e62c-aa82-46ed-8fbf-fcd0d42c3184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("df51b222-8234-4074-91c0-cdaaebfaa9a4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("df51b222-8234-4074-91c0-cdaaebfaa9a4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1872, tv_nsec: 872765881 } })
36042024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36052024-11-14T00:32:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36062024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 33 reason = Timeout
36072024-11-14T00:32:53.158ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
36082024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
36092024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
36102024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36112024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36122024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36132024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
36142024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
36152024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36162024-11-14T00:32:53.158ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
36172024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36182024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
36192024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
36202024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
36212024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36222024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36232024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
36242024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36252024-11-14T00:32:53.158ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1ab1c44d-7d9e-4861-bc1e-704f908d5ccd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("34921995-b6f6-4aad-8964-3692385af9d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("af9e2ff3-0008-44dc-81fb-c799d2026305.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("af9e2ff3-0008-44dc-81fb-c799d2026305.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1872, tv_nsec: 872948713 } })
36262024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
36272024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36282024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
36292024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36302024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36312024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
36322024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
36332024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
36342024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36352024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
36362024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36372024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36382024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36392024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
36402024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
36412024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
36422024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.341679ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
36432024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36442024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36452024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36462024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
36472024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36482024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
36492024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.319119ms iteration = 16 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
36502024-11-14T00:32:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
36512024-11-14T00:32:53.160ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
36522024-11-14T00:32:53.160ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
36532024-11-14T00:32:53.160ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
36542024-11-14T00:32:53.160ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
36552024-11-14T00:32:53.160ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
36562024-11-14T00:32:53.160ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
36572024-11-14T00:32:53.160ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
36582024-11-14T00:32:53.160ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36592024-11-14T00:32:53.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
36602024-11-14T00:32:53.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
36612024-11-14T00:32:53.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
36622024-11-14T00:32:53.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
36632024-11-14T00:32:53.161ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
36642024-11-14T00:32:53.161ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
36652024-11-14T00:32:53.161ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36662024-11-14T00:32:53.161ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
36672024-11-14T00:32:53.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
36682024-11-14T00:32:53.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
36692024-11-14T00:32:53.162ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36702024-11-14T00:32:53.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
36712024-11-14T00:32:53.167ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 10.101352ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
36722024-11-14T00:32:53.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36732024-11-14T00:32:53.170ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1872, tv_nsec: 885243676 } })
36742024-11-14T00:32:53.170ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1872, tv_nsec: 885347368 } })
36752024-11-14T00:32:53.170ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36762024-11-14T00:32:53.170ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
36772024-11-14T00:32:53.171ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
36782024-11-14T00:32:53.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36792024-11-14T00:32:53.172ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 00:22:53.157382750 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
36802024-11-14T00:32:53.172ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.362757ms iteration = 15 status = {"expiration":"2024-11-14T00:22:53.157382750Z","pruned":[]}
36812024-11-14T00:32:53.173ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
36822024-11-14T00:32:53.173ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36832024-11-14T00:32:53.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
36842024-11-14T00:32:53.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36852024-11-14T00:32:53.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36862024-11-14T00:32:53.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36872024-11-14T00:32:53.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
36882024-11-14T00:32:53.175ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36892024-11-14T00:32:53.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36902024-11-14T00:32:53.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36912024-11-14T00:32:53.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36922024-11-14T00:32:53.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
36932024-11-14T00:32:53.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36942024-11-14T00:32:53.184ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36952024-11-14T00:32:53.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36962024-11-14T00:32:53.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36972024-11-14T00:32:53.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
36982024-11-14T00:32:53.185ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36992024-11-14T00:32:53.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37002024-11-14T00:32:53.187ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37012024-11-14T00:32:53.188ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37022024-11-14T00:32:53.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37032024-11-14T00:32:53.190ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37042024-11-14T00:32:53.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37052024-11-14T00:32:53.192ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37062024-11-14T00:32:53.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37072024-11-14T00:32:53.192ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37082024-11-14T00:32:53.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37092024-11-14T00:32:53.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37102024-11-14T00:32:53.195ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37112024-11-14T00:32:53.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37122024-11-14T00:32:53.196ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 35.363978ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
37132024-11-14T00:32:53.200ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37142024-11-14T00:32:53.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37152024-11-14T00:32:53.201ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.549043ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37162024-11-14T00:32:53.204ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1872, tv_nsec: 919198784 } })
37172024-11-14T00:32:53.204ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37182024-11-14T00:32:53.204ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37192024-11-14T00:32:53.204ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
37202024-11-14T00:32:53.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37212024-11-14T00:32:53.205ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37222024-11-14T00:32:53.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37232024-11-14T00:32:53.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37242024-11-14T00:32:53.206ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37252024-11-14T00:32:53.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37262024-11-14T00:32:53.208ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37272024-11-14T00:32:53.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37282024-11-14T00:32:53.211ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37292024-11-14T00:32:53.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37302024-11-14T00:32:53.213ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37312024-11-14T00:32:53.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
37322024-11-14T00:32:53.217ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37332024-11-14T00:32:53.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37342024-11-14T00:32:53.238ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37352024-11-14T00:32:53.240ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37362024-11-14T00:32:53.240ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37372024-11-14T00:32:53.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37382024-11-14T00:32:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37392024-11-14T00:32:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
37402024-11-14T00:32:53.241ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
37412024-11-14T00:32:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
37422024-11-14T00:32:53.247ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37432024-11-14T00:32:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37442024-11-14T00:32:53.252ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
37452024-11-14T00:32:53.252ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
37462024-11-14T00:32:53.252ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 91.466326ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
37472024-11-14T00:32:53.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37482024-11-14T00:32:53.253ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37492024-11-14T00:32:53.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37502024-11-14T00:32:53.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37512024-11-14T00:32:53.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37522024-11-14T00:32:53.258ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 95.847869ms iteration = 29 status = {"errors":[],"records_set_to_done":[]}
37532024-11-14T00:32:53.259ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.415604ms iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
37542024-11-14T00:32:53.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
37552024-11-14T00:32:53.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37562024-11-14T00:32:53.267ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 106.804613ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
37572024-11-14T00:32:53.267ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37582024-11-14T00:32:53.267ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 109.664463ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37592024-11-14T00:32:53.268ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 110.13316ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37602024-11-14T00:32:53.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e211d163-be78-4663-b73f-baf5e9462a10, lookup_type: ById(e211d163-be78-4663-b73f-baf5e9462a10) } result = Ok(())
37612024-11-14T00:32:53.268ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37622024-11-14T00:32:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37632024-11-14T00:32:53.270ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37642024-11-14T00:32:53.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37652024-11-14T00:32:53.271ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 113.295334ms iteration = 29 status = 0
37662024-11-14T00:32:53.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
37672024-11-14T00:32:53.275ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37682024-11-14T00:32:53.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37692024-11-14T00:32:53.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
37702024-11-14T00:32:53.281ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37712024-11-14T00:32:53.284ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37722024-11-14T00:32:53.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37732024-11-14T00:32:53.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37742024-11-14T00:32:53.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37752024-11-14T00:32:53.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37762024-11-14T00:32:53.296ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 134.066147ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
37772024-11-14T00:32:53.296ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
37782024-11-14T00:32:53.296ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 139.584404ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
37792024-11-14T00:32:53.299ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
37802024-11-14T00:32:53.300ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37812024-11-14T00:32:53.300ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
37822024-11-14T00:32:53.300ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37832024-11-14T00:32:53.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37842024-11-14T00:32:53.301ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
37852024-11-14T00:32:53.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
37862024-11-14T00:32:53.304ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
37872024-11-14T00:32:53.304ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
37882024-11-14T00:32:53.304ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
37892024-11-14T00:32:53.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37902024-11-14T00:32:53.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37912024-11-14T00:32:53.308ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
37922024-11-14T00:32:53.308ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
37932024-11-14T00:32:53.308ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 150.866473ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
37942024-11-14T00:32:53.322ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
37952024-11-14T00:32:53.322ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
37962024-11-14T00:32:53.322ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
37972024-11-14T00:32:53.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37982024-11-14T00:32:53.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37992024-11-14T00:32:53.331ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38002024-11-14T00:32:53.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38012024-11-14T00:32:53.333ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38022024-11-14T00:32:53.334ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
38032024-11-14T00:32:53.334ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38042024-11-14T00:32:53.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38052024-11-14T00:32:53.338ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
38062024-11-14T00:32:53.338ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38072024-11-14T00:32:53.338ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9981d30-422d-4227-9467-227817d01fa1", "content-length": "26", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} })
38082024-11-14T00:32:53.338ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38092024-11-14T00:32:53.341ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38102024-11-14T00:32:53.360ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 201.910041ms iteration = 32 status = {"physical_disks_added":0}
38112024-11-14T00:32:53.451ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
38122024-11-14T00:32:53.451ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38132024-11-14T00:32:53.451ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f390864-6078-47c1-b52a-c32b32fd9a11", "content-length": "372", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} })
38142024-11-14T00:32:53.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38152024-11-14T00:32:53.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38162024-11-14T00:32:53.454ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38172024-11-14T00:32:53.456ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38182024-11-14T00:32:53.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
38192024-11-14T00:32:53.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38202024-11-14T00:32:53.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38212024-11-14T00:32:53.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38222024-11-14T00:32:53.460ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38232024-11-14T00:32:53.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38242024-11-14T00:32:53.472ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
38252024-11-14T00:32:53.514ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38262024-11-14T00:32:53.514ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38272024-11-14T00:32:53.514ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 356.184132ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38282024-11-14T00:32:53.528ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 zone_address = fd00:1122:3344:101::2
38292024-11-14T00:32:53.528ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38302024-11-14T00:32:53.529ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ffea0b8-1163-49c4-b078-a9db936b1873", "content-length": "26", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} })
38312024-11-14T00:32:53.529ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38322024-11-14T00:32:53.532ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
38332024-11-14T00:32:53.536ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
38342024-11-14T00:32:53.536ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2249d3ef-e161-463e-bd03-3f37771eab48 dns_zone_name = oxide.test found_so_far = 0 version = 2
38352024-11-14T00:32:53.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38362024-11-14T00:32:53.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38372024-11-14T00:32:53.537ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
38382024-11-14T00:32:53.537ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 501e9987-47e9-4194-a5b0-10ee954fd76c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
38392024-11-14T00:32:53.537ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38402024-11-14T00:32:53.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38412024-11-14T00:32:53.541ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T00:18:50.724288Z, time_modified: 2024-11-14T00:18:50.724288Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, db_silo: Silo { identity: SiloIdentity { id: bf9014ac-edb7-4293-a1ff-4004060e0581, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T00:18:55.151722Z, time_modified: 2024-11-14T00:18:55.151722Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, db_silo: Silo { identity: SiloIdentity { id: bf9014ac-edb7-4293-a1ff-4004060e0581, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T00:18:55.151722Z, time_modified: 2024-11-14T00:18:55.151722Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52" }] }) }
38422024-11-14T00:32:53.541ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 384.184796ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bf9014ac-edb7-4293-a1ff-4004060e0581","tls_certs":["0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52"]}},"default_endpoint":{"silo_id":"bf9014ac-edb7-4293-a1ff-4004060e0581","tls_certs":["0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
38432024-11-14T00:32:53.545ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
38442024-11-14T00:32:53.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38452024-11-14T00:32:53.555ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
38462024-11-14T00:32:53.555ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
38472024-11-14T00:32:53.555ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "26c88325-c2c0-4659-a256-dc8cc37a0df2", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} })
38482024-11-14T00:32:53.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38492024-11-14T00:32:53.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38502024-11-14T00:32:53.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38512024-11-14T00:32:53.556ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38522024-11-14T00:32:53.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38532024-11-14T00:32:53.558ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 400.847971ms iteration = 29 status = {}
38542024-11-14T00:32:53.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38552024-11-14T00:32:53.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38562024-11-14T00:32:53.559ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 501e9987-47e9-4194-a5b0-10ee954fd76c dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
38572024-11-14T00:32:53.559ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
38582024-11-14T00:32:53.559ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 00:18:53.692551 UTC dns_group = internal generation = 1
38592024-11-14T00:32:53.559ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 401.963386ms iteration = 16 status = {"generation":1}
38602024-11-14T00:32:53.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38612024-11-14T00:32:53.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38622024-11-14T00:32:53.569ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38632024-11-14T00:32:53.569ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38642024-11-14T00:32:53.569ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0568fb90-0929-4450-b0f9-c3f97fe70785", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} })
38652024-11-14T00:32:53.571ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 413.482488ms iteration = 33 status = {}
38662024-11-14T00:32:53.589ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38672024-11-14T00:32:53.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
38682024-11-14T00:32:53.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38692024-11-14T00:32:53.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38702024-11-14T00:32:53.593ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2249d3ef-e161-463e-bd03-3f37771eab48 dns_zone_name = oxide.test found_so_far = 1 version = 2
38712024-11-14T00:32:53.593ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
38722024-11-14T00:32:53.593ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 00:18:55.211515 UTC dns_group = external generation = 2
38732024-11-14T00:32:53.593ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 436.190258ms iteration = 16 status = {"generation":2}
38742024-11-14T00:32:53.596ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
38752024-11-14T00:32:53.596ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 437.976973ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
38762024-11-14T00:32:53.605ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38772024-11-14T00:32:53.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38782024-11-14T00:32:53.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38792024-11-14T00:32:53.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38802024-11-14T00:32:53.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38812024-11-14T00:32:53.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38822024-11-14T00:32:53.610ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38832024-11-14T00:32:53.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38842024-11-14T00:32:53.611ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38852024-11-14T00:32:53.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38862024-11-14T00:32:53.619ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
38872024-11-14T00:32:53.619ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38882024-11-14T00:32:53.620ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6850ef35-1c81-411e-b8d5-00fa83f1da81", "content-length": "26", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} })
38892024-11-14T00:32:53.620ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38902024-11-14T00:32:53.621ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38912024-11-14T00:32:53.625ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
38922024-11-14T00:32:53.625ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4c2154a6-1903-4461-abb7-291c4123b54d", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
38932024-11-14T00:32:53.625ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
38942024-11-14T00:32:53.627ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "97566fa0-3e66-4918-946b-5e576667c517", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
38952024-11-14T00:32:53.627ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
38962024-11-14T00:32:53.629ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "86e1c7eb-6760-4dae-8600-63430d6048a3", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
38972024-11-14T00:32:53.629ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
38982024-11-14T00:32:53.630ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
38992024-11-14T00:32:53.630ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 473.596964ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
39002024-11-14T00:32:53.728ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
39012024-11-14T00:32:53.728ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3da3f48-0bd9-44bc-a7e3-4aa68b86d2a8", "content-length": "2", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} })
39022024-11-14T00:32:53.730ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39032024-11-14T00:32:53.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39042024-11-14T00:32:53.732ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 575.341306ms iteration = 29 status = null
39052024-11-14T00:32:53.786ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
39062024-11-14T00:32:53.786ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "34fe1ec8-414e-488b-abc7-d2f7ded40b83", "content-length": "691", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} })
39072024-11-14T00:32:53.786ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
39082024-11-14T00:32:53.786ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
39092024-11-14T00:32:53.786ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
39102024-11-14T00:32:53.788ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 630.261719ms iteration = 31 status = {}
39112024-11-14T00:32:53.794ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
39122024-11-14T00:32:53.795ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b6f8ebc3-86f9-425b-9270-18e67c1e87ea", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
39132024-11-14T00:32:53.795ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
39142024-11-14T00:32:53.797ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5a0cdb52-069b-423f-aa69-d17f9271bcb1", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
39152024-11-14T00:32:53.797ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
39162024-11-14T00:32:53.798ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
39172024-11-14T00:32:53.798ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 641.435336ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
39182024-11-14T00:32:53.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39192024-11-14T00:32:53.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39202024-11-14T00:32:53.860ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1b492b5b-8c3a-4e99-9528-5d52a91581c5, rack_id: fcfbb675-622a-4d07-9c7d-02f1c7317864, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b) } rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
39212024-11-14T00:32:53.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39222024-11-14T00:32:53.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39232024-11-14T00:32:53.869ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
39242024-11-14T00:32:53.869ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "de496423-b267-4010-aa11-b08c237ad28b", "content-length": "134", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} })
39252024-11-14T00:32:53.869ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
39262024-11-14T00:32:53.869ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b
39272024-11-14T00:32:53.870ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
39282024-11-14T00:32:53.870ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39292024-11-14T00:32:53.870ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39302024-11-14T00:32:53.870ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39312024-11-14T00:32:53.870ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39322024-11-14T00:32:53.870ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39332024-11-14T00:32:53.870ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39342024-11-14T00:32:53.870ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39352024-11-14T00:32:53.870ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
39362024-11-14T00:32:53.870ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39372024-11-14T00:32:53.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39382024-11-14T00:32:53.872ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
39392024-11-14T00:32:53.872ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4512edac-444c-4170-a334-3ee9c1f9abe0", "content-length": "2", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} })
39402024-11-14T00:32:53.872ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
39412024-11-14T00:32:53.872ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "adbd06ce-c6ad-4f83-a3d8-381b345a1fec", "content-length": "52", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} })
39422024-11-14T00:32:53.872ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
39432024-11-14T00:32:53.872ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39442024-11-14T00:32:53.974ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9048f427-5294-4bcd-98ae-7fe944e89139", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} })
39452024-11-14T00:32:53.974ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch = Switch0
39462024-11-14T00:32:53.974ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39472024-11-14T00:32:53.974ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2631d81-dcff-4e8c-a7e7-1289d7f75472", "content-length": "682", "date": "Thu, 14 Nov 2024 00:32:53 GMT"} })
39482024-11-14T00:32:53.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39492024-11-14T00:32:53.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39502024-11-14T00:32:53.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39512024-11-14T00:32:53.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39522024-11-14T00:32:53.982ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39532024-11-14T00:32:53.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39542024-11-14T00:32:53.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39552024-11-14T00:32:53.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39562024-11-14T00:32:53.991ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 833.888074ms iteration = 29 status = {}
39572024-11-14T00:33:00.950ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2055 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = 21ef0178-5821-4661-b117-71fdd0b18f6f response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
39582024-11-14T00:33:03.157ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
39592024-11-14T00:33:03.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39602024-11-14T00:33:03.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39612024-11-14T00:33:03.158ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
39622024-11-14T00:33:03.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39632024-11-14T00:33:03.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39642024-11-14T00:33:03.159ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39652024-11-14T00:33:03.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39662024-11-14T00:33:03.161ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39672024-11-14T00:33:03.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39682024-11-14T00:33:03.164ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39692024-11-14T00:33:03.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39702024-11-14T00:33:03.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39712024-11-14T00:33:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
39722024-11-14T00:33:03.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39732024-11-14T00:33:03.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39742024-11-14T00:33:03.179ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
39752024-11-14T00:33:03.179ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.118221ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
39762024-11-14T00:33:03.190ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39772024-11-14T00:33:03.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39782024-11-14T00:33:03.219ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.06561ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39792024-11-14T00:33:13.158ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
39802024-11-14T00:33:13.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39812024-11-14T00:33:13.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39822024-11-14T00:33:13.158ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
39832024-11-14T00:33:13.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39842024-11-14T00:33:13.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39852024-11-14T00:33:13.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39862024-11-14T00:33:13.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39872024-11-14T00:33:13.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39882024-11-14T00:33:13.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39892024-11-14T00:33:13.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39902024-11-14T00:33:13.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39912024-11-14T00:33:13.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39922024-11-14T00:33:13.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
39932024-11-14T00:33:13.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39942024-11-14T00:33:13.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39952024-11-14T00:33:13.180ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
39962024-11-14T00:33:13.180ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.306394ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
39972024-11-14T00:33:13.187ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39982024-11-14T00:33:13.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39992024-11-14T00:33:13.188ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.906431ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40002024-11-14T00:33:15.949ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2162 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = f81c8fee-5930-4c7e-a778-5b98ab5e7a8b response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
40012024-11-14T00:33:23.157ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
40022024-11-14T00:33:23.157ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40032024-11-14T00:33:23.157ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
40042024-11-14T00:33:23.157ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
40052024-11-14T00:33:23.157ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40062024-11-14T00:33:23.157ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
40072024-11-14T00:33:23.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40082024-11-14T00:33:23.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40092024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
40102024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40112024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
40122024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
40132024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 34 reason = Timeout
40142024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40152024-11-14T00:33:23.158ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
40162024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
40172024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40182024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40192024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
40202024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40212024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40222024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
40232024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
40242024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
40252024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40262024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40272024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
40282024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40292024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 32 reason = Timeout
40302024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40312024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40322024-11-14T00:33:23.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40332024-11-14T00:33:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40342024-11-14T00:33:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40352024-11-14T00:33:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40362024-11-14T00:33:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40372024-11-14T00:33:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40382024-11-14T00:33:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40392024-11-14T00:33:23.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40402024-11-14T00:33:23.160ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
40412024-11-14T00:33:23.160ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
40422024-11-14T00:33:23.160ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40432024-11-14T00:33:23.160ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
40442024-11-14T00:33:23.160ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1902, tv_nsec: 875070783 } })
40452024-11-14T00:33:23.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40462024-11-14T00:33:23.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40472024-11-14T00:33:23.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40482024-11-14T00:33:23.160ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
40492024-11-14T00:33:23.161ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40502024-11-14T00:33:23.161ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1902, tv_nsec: 875819813 } })
40512024-11-14T00:33:23.161ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
40522024-11-14T00:33:23.161ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
40532024-11-14T00:33:23.161ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40542024-11-14T00:33:23.161ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
40552024-11-14T00:33:23.161ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
40562024-11-14T00:33:23.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40572024-11-14T00:33:23.161ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40582024-11-14T00:33:23.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40592024-11-14T00:33:23.161ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.31642ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40602024-11-14T00:33:23.162ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40612024-11-14T00:33:23.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40622024-11-14T00:33:23.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40632024-11-14T00:33:23.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40642024-11-14T00:33:23.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40652024-11-14T00:33:23.164ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40662024-11-14T00:33:23.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40672024-11-14T00:33:23.164ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40682024-11-14T00:33:23.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40692024-11-14T00:33:23.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40702024-11-14T00:33:23.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40712024-11-14T00:33:23.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40722024-11-14T00:33:23.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40732024-11-14T00:33:23.169ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40742024-11-14T00:33:23.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40752024-11-14T00:33:23.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40762024-11-14T00:33:23.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40772024-11-14T00:33:23.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40782024-11-14T00:33:23.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40792024-11-14T00:33:23.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.155347ms iteration = 30 status = {"errors":[],"records_set_to_done":[]}
40802024-11-14T00:33:23.184ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1902, tv_nsec: 898503483 } })
40812024-11-14T00:33:23.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40822024-11-14T00:33:23.184ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
40832024-11-14T00:33:23.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40842024-11-14T00:33:23.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40852024-11-14T00:33:23.190ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40862024-11-14T00:33:23.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
40872024-11-14T00:33:23.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40882024-11-14T00:33:23.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40892024-11-14T00:33:23.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40902024-11-14T00:33:23.206ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40912024-11-14T00:33:23.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40922024-11-14T00:33:23.209ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40932024-11-14T00:33:23.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40942024-11-14T00:33:23.209ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
40952024-11-14T00:33:23.209ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.273036ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
40962024-11-14T00:33:23.211ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40972024-11-14T00:33:23.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40982024-11-14T00:33:23.213ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40992024-11-14T00:33:23.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41002024-11-14T00:33:23.217ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41012024-11-14T00:33:23.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41022024-11-14T00:33:23.220ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41032024-11-14T00:33:23.220ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
41042024-11-14T00:33:23.220ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41052024-11-14T00:33:23.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41062024-11-14T00:33:23.220ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.099823ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41072024-11-14T00:33:23.220ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41082024-11-14T00:33:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41092024-11-14T00:33:23.221ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41102024-11-14T00:33:23.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41112024-11-14T00:33:23.222ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41122024-11-14T00:33:23.222ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.371208ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
41132024-11-14T00:33:23.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41142024-11-14T00:33:23.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41152024-11-14T00:33:23.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41162024-11-14T00:33:23.228ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41172024-11-14T00:33:23.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41182024-11-14T00:33:23.234ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
41192024-11-14T00:33:23.234ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.917379ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
41202024-11-14T00:33:23.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41212024-11-14T00:33:23.236ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
41222024-11-14T00:33:23.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41232024-11-14T00:33:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41242024-11-14T00:33:23.267ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
41252024-11-14T00:33:23.267ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41262024-11-14T00:33:23.268ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 107.707606ms iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
41272024-11-14T00:33:23.268ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bed5b07f-1b2b-4b20-8faf-b0d2a36e9057", "content-length": "26", "date": "Thu, 14 Nov 2024 00:33:23 GMT"} })
41282024-11-14T00:33:23.268ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41292024-11-14T00:33:23.270ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41302024-11-14T00:33:23.270ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
41312024-11-14T00:33:23.270ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41322024-11-14T00:33:23.270ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41332024-11-14T00:33:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41342024-11-14T00:33:23.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41352024-11-14T00:33:23.272ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 114.105745ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
41362024-11-14T00:33:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e211d163-be78-4663-b73f-baf5e9462a10, lookup_type: ById(e211d163-be78-4663-b73f-baf5e9462a10) } result = Ok(())
41372024-11-14T00:33:23.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41382024-11-14T00:33:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41392024-11-14T00:33:23.276ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 118.262434ms iteration = 30 status = 0
41402024-11-14T00:33:23.277ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41412024-11-14T00:33:23.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41422024-11-14T00:33:23.307ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41432024-11-14T00:33:23.307ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41442024-11-14T00:33:23.307ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.156309ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41452024-11-14T00:33:23.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41462024-11-14T00:33:23.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41472024-11-14T00:33:23.317ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 155.740671ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
41482024-11-14T00:33:23.344ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
41492024-11-14T00:33:23.344ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41502024-11-14T00:33:23.344ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b734cdcb-bf70-45c4-8f14-b4073a0e6106", "content-length": "26", "date": "Thu, 14 Nov 2024 00:33:23 GMT"} })
41512024-11-14T00:33:23.344ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41522024-11-14T00:33:23.346ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41532024-11-14T00:33:23.356ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 197.56823ms iteration = 33 status = {"physical_disks_added":0}
41542024-11-14T00:33:23.368ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 zone_address = fd00:1122:3344:101::2
41552024-11-14T00:33:23.368ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41562024-11-14T00:33:23.368ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76bdb97a-2616-4d21-bbb1-3e215d8ab5f6", "content-length": "26", "date": "Thu, 14 Nov 2024 00:33:23 GMT"} })
41572024-11-14T00:33:23.368ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41582024-11-14T00:33:23.370ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
41592024-11-14T00:33:23.374ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41602024-11-14T00:33:23.374ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9ffa0e5-f4df-4d94-b8cd-b112385d01de", "content-length": "2", "date": "Thu, 14 Nov 2024 00:33:23 GMT"} })
41612024-11-14T00:33:23.375ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41622024-11-14T00:33:23.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41632024-11-14T00:33:23.451ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 293.919366ms iteration = 30 status = {}
41642024-11-14T00:33:23.485ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41652024-11-14T00:33:23.485ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41662024-11-14T00:33:23.486ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "59e8c370-308b-46d2-a8f5-4c5b0e8103de", "content-length": "372", "date": "Thu, 14 Nov 2024 00:33:23 GMT"} })
41672024-11-14T00:33:23.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41682024-11-14T00:33:23.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41692024-11-14T00:33:23.488ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 331.021118ms iteration = 30 status = null
41702024-11-14T00:33:23.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41712024-11-14T00:33:23.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41722024-11-14T00:33:23.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41732024-11-14T00:33:23.530ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
41742024-11-14T00:33:23.530ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41752024-11-14T00:33:23.530ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2e94db5f-ac98-4219-847b-914a657c4b1e", "date": "Thu, 14 Nov 2024 00:33:23 GMT"} })
41762024-11-14T00:33:23.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41772024-11-14T00:33:23.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41782024-11-14T00:33:23.531ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41792024-11-14T00:33:23.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41802024-11-14T00:33:23.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41812024-11-14T00:33:23.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41822024-11-14T00:33:23.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41832024-11-14T00:33:23.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41842024-11-14T00:33:23.534ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
41852024-11-14T00:33:23.534ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41862024-11-14T00:33:23.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41872024-11-14T00:33:23.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41882024-11-14T00:33:23.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41892024-11-14T00:33:23.540ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41902024-11-14T00:33:23.540ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41912024-11-14T00:33:23.541ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1721de3b-eefd-4423-a1ef-d47a603cf10d", "date": "Thu, 14 Nov 2024 00:33:23 GMT"} })
41922024-11-14T00:33:23.542ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 383.911443ms iteration = 34 status = {}
41932024-11-14T00:33:23.564ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41942024-11-14T00:33:23.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41952024-11-14T00:33:23.566ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1b492b5b-8c3a-4e99-9528-5d52a91581c5, rack_id: fcfbb675-622a-4d07-9c7d-02f1c7317864, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b) } rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
41962024-11-14T00:33:23.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41972024-11-14T00:33:23.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41982024-11-14T00:33:23.575ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41992024-11-14T00:33:23.575ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "874a91d8-8720-489f-a094-d9d49ce081a1", "content-length": "134", "date": "Thu, 14 Nov 2024 00:33:23 GMT"} })
42002024-11-14T00:33:23.575ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
42012024-11-14T00:33:23.576ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b
42022024-11-14T00:33:23.576ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
42032024-11-14T00:33:23.576ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
42042024-11-14T00:33:23.576ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42052024-11-14T00:33:23.576ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42062024-11-14T00:33:23.576ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42072024-11-14T00:33:23.576ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42082024-11-14T00:33:23.576ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
42092024-11-14T00:33:23.576ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
42102024-11-14T00:33:23.576ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
42112024-11-14T00:33:23.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42122024-11-14T00:33:23.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42132024-11-14T00:33:23.578ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
42142024-11-14T00:33:23.578ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "90e65f84-b992-4bdf-8df6-e4f6f16ae105", "content-length": "2", "date": "Thu, 14 Nov 2024 00:33:23 GMT"} })
42152024-11-14T00:33:23.578ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
42162024-11-14T00:33:23.578ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "72add6df-f6f8-4a3e-9161-267d497a5acf", "content-length": "52", "date": "Thu, 14 Nov 2024 00:33:23 GMT"} })
42172024-11-14T00:33:23.578ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
42182024-11-14T00:33:23.578ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
42192024-11-14T00:33:23.620ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
42202024-11-14T00:33:23.662ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c16b4c2d-c68b-41cc-a65d-bad48cfecae5", "content-length": "691", "date": "Thu, 14 Nov 2024 00:33:23 GMT"} })
42212024-11-14T00:33:23.662ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
42222024-11-14T00:33:23.662ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
42232024-11-14T00:33:23.662ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
42242024-11-14T00:33:23.664ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 505.557994ms iteration = 32 status = {}
42252024-11-14T00:33:23.762ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "67fd4f76-904e-4a54-9805-0fb03b39ef85", "date": "Thu, 14 Nov 2024 00:33:23 GMT"} })
42262024-11-14T00:33:23.762ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch = Switch0
42272024-11-14T00:33:23.763ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
42282024-11-14T00:33:23.769ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2216df5f-9ba7-4b47-80cf-545478d4f1d4", "content-length": "682", "date": "Thu, 14 Nov 2024 00:33:23 GMT"} })
42292024-11-14T00:33:23.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42302024-11-14T00:33:23.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42312024-11-14T00:33:23.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42322024-11-14T00:33:23.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42332024-11-14T00:33:23.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42342024-11-14T00:33:23.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42352024-11-14T00:33:23.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42362024-11-14T00:33:23.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42372024-11-14T00:33:23.786ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 627.782915ms iteration = 30 status = {}
42382024-11-14T00:33:30.949ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2090 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = 61ca7f90-cfbe-49c4-97d3-ef99dd8b02fc response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
42392024-11-14T00:33:33.158ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
42402024-11-14T00:33:33.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42412024-11-14T00:33:33.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42422024-11-14T00:33:33.159ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
42432024-11-14T00:33:33.159ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42442024-11-14T00:33:33.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42452024-11-14T00:33:33.161ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42462024-11-14T00:33:33.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42472024-11-14T00:33:33.187ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42482024-11-14T00:33:33.189ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.220905ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42492024-11-14T00:33:33.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42502024-11-14T00:33:33.189ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42512024-11-14T00:33:33.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42522024-11-14T00:33:33.192ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42532024-11-14T00:33:33.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42542024-11-14T00:33:33.193ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42552024-11-14T00:33:33.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
42562024-11-14T00:33:33.196ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42572024-11-14T00:33:33.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42582024-11-14T00:33:33.208ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
42592024-11-14T00:33:33.208ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.082015ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
42602024-11-14T00:33:43.158ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
42612024-11-14T00:33:43.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42622024-11-14T00:33:43.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42632024-11-14T00:33:43.158ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
42642024-11-14T00:33:43.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42652024-11-14T00:33:43.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42662024-11-14T00:33:43.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42672024-11-14T00:33:43.160ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42682024-11-14T00:33:43.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42692024-11-14T00:33:43.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42702024-11-14T00:33:43.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42712024-11-14T00:33:43.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42722024-11-14T00:33:43.164ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42732024-11-14T00:33:43.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42742024-11-14T00:33:43.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42752024-11-14T00:33:43.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
42762024-11-14T00:33:43.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42772024-11-14T00:33:43.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42782024-11-14T00:33:43.178ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
42792024-11-14T00:33:43.178ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.801399ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
42802024-11-14T00:33:43.189ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.650451ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42812024-11-14T00:33:45.950ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2654 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = 756cfdbe-ce91-4d5d-ab63-f9472aec233a response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
42822024-11-14T00:33:50.941ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:35081
42832024-11-14T00:33:50.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35081 req_id = 9064fd60-46d7-4216-95dc-9a1efe9f6fe8 roles = RoleSet { roles: {} } uri = /metrics/collectors/ad042fde-503a-4314-8c8c-afa2f783d145/producers?sort_by=id_ascending
42842024-11-14T00:33:50.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35081 req_id = 9064fd60-46d7-4216-95dc-9a1efe9f6fe8 resource = Database result = Ok(()) uri = /metrics/collectors/ad042fde-503a-4314-8c8c-afa2f783d145/producers?sort_by=id_ascending
42852024-11-14T00:33:50.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2855 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35081 req_id = 9064fd60-46d7-4216-95dc-9a1efe9f6fe8 response_code = 200 uri = /metrics/collectors/ad042fde-503a-4314-8c8c-afa2f783d145/producers?sort_by=id_ascending
42862024-11-14T00:33:50.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35081 req_id = 88dbcad8-6120-4c8a-b22f-404443382d09 roles = RoleSet { roles: {} } uri = /metrics/collectors/ad042fde-503a-4314-8c8c-afa2f783d145/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTRiNmQ3YS03ZmM4LTQxMTAtOTdjYS1kNTE5ZTBiYWQ3OWYifX0%3D
42872024-11-14T00:33:50.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35081 req_id = 88dbcad8-6120-4c8a-b22f-404443382d09 resource = Database result = Ok(()) uri = /metrics/collectors/ad042fde-503a-4314-8c8c-afa2f783d145/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTRiNmQ3YS03ZmM4LTQxMTAtOTdjYS1kNTE5ZTBiYWQ3OWYifX0%3D
42882024-11-14T00:33:50.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2424 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35081 req_id = 88dbcad8-6120-4c8a-b22f-404443382d09 response_code = 200 uri = /metrics/collectors/ad042fde-503a-4314-8c8c-afa2f783d145/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmYTRiNmQ3YS03ZmM4LTQxMTAtOTdjYS1kNTE5ZTBiYWQ3OWYifX0%3D
42892024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 18 reason = Timeout
42902024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 18 reason = Timeout
42912024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 17 reason = Timeout
42922024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 31 reason = Timeout
42932024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42942024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 16 reason = Timeout
42952024-11-14T00:33:53.158ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-14 00:23:53.158093698 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42962024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 17 reason = Timeout
42972024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42982024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 17 reason = Timeout
42992024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43002024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
43012024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 91 reason = Timeout
43022024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43032024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43042024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 31 reason = Timeout
43052024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 17 reason = Timeout
43062024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
43072024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43082024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 17 reason = Timeout
43092024-11-14T00:33:53.158ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f
43102024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.71\u{b5}s iteration = 17 status = {"enabled":false,"target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f"}
43112024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 31 reason = Timeout
43122024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43132024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 17 reason = Timeout
43142024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43152024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43162024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43172024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43182024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43192024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43202024-11-14T00:33:53.158ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6880e62c-aa82-46ed-8fbf-fcd0d42c3184.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("df51b222-8234-4074-91c0-cdaaebfaa9a4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("df51b222-8234-4074-91c0-cdaaebfaa9a4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1932, tv_nsec: 872855502 } })
43212024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 7 reason = Timeout
43222024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
43232024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43242024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43252024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43262024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
43272024-11-14T00:33:53.158ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43282024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43292024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 91 reason = Timeout
43302024-11-14T00:33:53.159ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1ab1c44d-7d9e-4861-bc1e-704f908d5ccd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("34921995-b6f6-4aad-8964-3692385af9d6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("af9e2ff3-0008-44dc-81fb-c799d2026305.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("af9e2ff3-0008-44dc-81fb-c799d2026305.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1932, tv_nsec: 873057475 } })
43312024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43322024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 31 reason = Timeout
43332024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 31 reason = Timeout
43342024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43352024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43362024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 16 reason = Timeout
43372024-11-14T00:33:53.159ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
43382024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43392024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 33 reason = Timeout
43402024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43412024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 31 reason = Timeout
43422024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43432024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 31 reason = Timeout
43442024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43452024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43462024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43472024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43482024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 16 reason = Timeout
43492024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43502024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43512024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 4 reason = Timeout
43522024-11-14T00:33:53.159ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
43532024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43542024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43552024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 35 reason = Timeout
43562024-11-14T00:33:53.159ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43572024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43582024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43592024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43602024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43612024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43622024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43632024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43642024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43652024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43662024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43672024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43682024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43692024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43702024-11-14T00:33:53.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43712024-11-14T00:33:53.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43722024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43732024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43742024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
43752024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
43762024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.553316ms iteration = 17 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
43772024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.350763ms iteration = 17 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
43782024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 16 reason = Timeout
43792024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
43802024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
43812024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 16 reason = Timeout
43822024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
43832024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
43842024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 31 reason = Timeout
43852024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43862024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43872024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 31 reason = Timeout
43882024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43892024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43902024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 31 reason = Timeout
43912024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43922024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43932024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 31 reason = Timeout
43942024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
43952024-11-14T00:33:53.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43962024-11-14T00:33:53.167ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-14 00:23:53.158093698 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43972024-11-14T00:33:53.167ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.147558ms iteration = 16 status = {"expiration":"2024-11-14T00:23:53.158093698Z","pruned":[]}
43982024-11-14T00:33:53.167ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1932, tv_nsec: 881620685 } })
43992024-11-14T00:33:53.167ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
44002024-11-14T00:33:53.170ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44012024-11-14T00:33:53.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44022024-11-14T00:33:53.171ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 13.173455ms iteration = 31 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
44032024-11-14T00:33:53.173ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44042024-11-14T00:33:53.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44052024-11-14T00:33:53.177ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1932, tv_nsec: 891218250 } })
44062024-11-14T00:33:53.177ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
44072024-11-14T00:33:53.179ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44082024-11-14T00:33:53.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44092024-11-14T00:33:53.181ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44102024-11-14T00:33:53.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44112024-11-14T00:33:53.188ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44122024-11-14T00:33:53.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44132024-11-14T00:33:53.192ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44142024-11-14T00:33:53.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44152024-11-14T00:33:53.196ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44162024-11-14T00:33:53.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44172024-11-14T00:33:53.197ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44182024-11-14T00:33:53.199ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 38.233308ms iteration = 16 status = {"errors":[],"found_port_ok":[]}
44192024-11-14T00:33:53.200ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44202024-11-14T00:33:53.200ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44212024-11-14T00:33:53.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44222024-11-14T00:33:53.203ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44232024-11-14T00:33:53.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44242024-11-14T00:33:53.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44252024-11-14T00:33:53.207ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44262024-11-14T00:33:53.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44272024-11-14T00:33:53.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44282024-11-14T00:33:53.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44292024-11-14T00:33:53.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44302024-11-14T00:33:53.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44312024-11-14T00:33:53.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44322024-11-14T00:33:53.238ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44332024-11-14T00:33:53.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44342024-11-14T00:33:53.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44352024-11-14T00:33:53.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44362024-11-14T00:33:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44372024-11-14T00:33:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44382024-11-14T00:33:53.242ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44392024-11-14T00:33:53.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44402024-11-14T00:33:53.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44412024-11-14T00:33:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44422024-11-14T00:33:53.246ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44432024-11-14T00:33:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
44442024-11-14T00:33:53.246ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44452024-11-14T00:33:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44462024-11-14T00:33:53.246ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44472024-11-14T00:33:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44482024-11-14T00:33:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44492024-11-14T00:33:53.249ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44502024-11-14T00:33:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44512024-11-14T00:33:53.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44522024-11-14T00:33:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44532024-11-14T00:33:53.249ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44542024-11-14T00:33:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44552024-11-14T00:33:53.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44562024-11-14T00:33:53.253ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44572024-11-14T00:33:53.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44582024-11-14T00:33:53.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44592024-11-14T00:33:53.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44602024-11-14T00:33:53.256ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44612024-11-14T00:33:53.256ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44622024-11-14T00:33:53.256ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44632024-11-14T00:33:53.256ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44642024-11-14T00:33:53.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44652024-11-14T00:33:53.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44662024-11-14T00:33:53.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44672024-11-14T00:33:53.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44682024-11-14T00:33:53.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44692024-11-14T00:33:53.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44702024-11-14T00:33:53.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44712024-11-14T00:33:53.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44722024-11-14T00:33:53.264ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44732024-11-14T00:33:53.266ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44742024-11-14T00:33:53.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44752024-11-14T00:33:53.267ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44762024-11-14T00:33:53.267ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 108.323774ms iteration = 91 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44772024-11-14T00:33:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44782024-11-14T00:33:53.267ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44792024-11-14T00:33:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44802024-11-14T00:33:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44812024-11-14T00:33:53.267ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44822024-11-14T00:33:53.268ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44832024-11-14T00:33:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44842024-11-14T00:33:53.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44852024-11-14T00:33:53.270ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44862024-11-14T00:33:53.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44872024-11-14T00:33:53.271ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44882024-11-14T00:33:53.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44892024-11-14T00:33:53.273ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 111.023212ms iteration = 31 status = {"errors":[],"garbage_collect_requested":[]}
44902024-11-14T00:33:53.274ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44912024-11-14T00:33:53.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44922024-11-14T00:33:53.276ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44932024-11-14T00:33:53.276ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44942024-11-14T00:33:53.276ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-e211d163-be78-4663-b73f-baf5e9462a10.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1932, tv_nsec: 990759661 } })
44952024-11-14T00:33:53.277ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
44962024-11-14T00:33:53.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44972024-11-14T00:33:53.279ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44982024-11-14T00:33:53.279ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
44992024-11-14T00:33:53.279ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
45002024-11-14T00:33:53.279ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 118.02027ms iteration = 16 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
45012024-11-14T00:33:53.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45022024-11-14T00:33:53.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
45032024-11-14T00:33:53.281ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45042024-11-14T00:33:53.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45052024-11-14T00:33:53.283ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 124.37439ms iteration = 7 status = {"nsuccess":5}
45062024-11-14T00:33:53.283ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45072024-11-14T00:33:53.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45082024-11-14T00:33:53.285ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45092024-11-14T00:33:53.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45102024-11-14T00:33:53.286ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 124.134467ms iteration = 31 status = {"errors":[],"records_set_to_done":[]}
45112024-11-14T00:33:53.288ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45122024-11-14T00:33:53.293ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45132024-11-14T00:33:53.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
45142024-11-14T00:33:53.293ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45152024-11-14T00:33:53.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45162024-11-14T00:33:53.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45172024-11-14T00:33:53.296ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
45182024-11-14T00:33:53.296ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45192024-11-14T00:33:53.296ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45202024-11-14T00:33:53.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
45212024-11-14T00:33:53.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45222024-11-14T00:33:53.300ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45232024-11-14T00:33:53.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45242024-11-14T00:33:53.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45252024-11-14T00:33:53.302ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 140.407525ms iteration = 31 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
45262024-11-14T00:33:53.303ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45272024-11-14T00:33:53.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45282024-11-14T00:33:53.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45292024-11-14T00:33:53.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45302024-11-14T00:33:53.305ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45312024-11-14T00:33:53.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
45322024-11-14T00:33:53.309ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45332024-11-14T00:33:53.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45342024-11-14T00:33:53.311ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
45352024-11-14T00:33:53.311ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
45362024-11-14T00:33:53.311ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
45372024-11-14T00:33:53.311ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45382024-11-14T00:33:53.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45392024-11-14T00:33:53.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45402024-11-14T00:33:53.313ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
45412024-11-14T00:33:53.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
45422024-11-14T00:33:53.314ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45432024-11-14T00:33:53.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45442024-11-14T00:33:53.315ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 156.007725ms iteration = 31 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
45452024-11-14T00:33:53.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45462024-11-14T00:33:53.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45472024-11-14T00:33:53.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45482024-11-14T00:33:53.317ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
45492024-11-14T00:33:53.317ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45502024-11-14T00:33:53.318ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ece3bffc-71a3-4fad-a55b-797aff8f6acb", "content-length": "26", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} })
45512024-11-14T00:33:53.318ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45522024-11-14T00:33:53.318ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
45532024-11-14T00:33:53.318ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
45542024-11-14T00:33:53.318ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 159.261421ms iteration = 16 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
45552024-11-14T00:33:53.318ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
45562024-11-14T00:33:53.318ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 2249d3ef-e161-463e-bd03-3f37771eab48 dns_zone_name = oxide.test found_so_far = 0 version = 2
45572024-11-14T00:33:53.318ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
45582024-11-14T00:33:53.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45592024-11-14T00:33:53.318ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 159.716327ms iteration = 31 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
45602024-11-14T00:33:53.318ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45612024-11-14T00:33:53.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45622024-11-14T00:33:53.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45632024-11-14T00:33:53.319ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45642024-11-14T00:33:53.319ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45652024-11-14T00:33:53.319ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45662024-11-14T00:33:53.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45672024-11-14T00:33:53.320ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45682024-11-14T00:33:53.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45692024-11-14T00:33:53.320ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45702024-11-14T00:33:53.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45712024-11-14T00:33:53.321ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45722024-11-14T00:33:53.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45732024-11-14T00:33:53.321ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
45742024-11-14T00:33:53.321ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45752024-11-14T00:33:53.322ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "09b4039a-11ee-4f99-9938-c9b1ebd07c16", "content-length": "26", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} })
45762024-11-14T00:33:53.322ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45772024-11-14T00:33:53.322ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45782024-11-14T00:33:53.323ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45792024-11-14T00:33:53.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45802024-11-14T00:33:53.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45812024-11-14T00:33:53.323ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
45822024-11-14T00:33:53.323ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45832024-11-14T00:33:53.324ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
45842024-11-14T00:33:53.324ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45852024-11-14T00:33:53.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45862024-11-14T00:33:53.325ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45872024-11-14T00:33:53.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45882024-11-14T00:33:53.326ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 2249d3ef-e161-463e-bd03-3f37771eab48 dns_zone_name = oxide.test found_so_far = 1 version = 2
45892024-11-14T00:33:53.326ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45902024-11-14T00:33:53.326ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
45912024-11-14T00:33:53.326ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-14 00:18:55.211515 UTC dns_group = external generation = 2
45922024-11-14T00:33:53.326ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 168.563512ms iteration = 17 status = {"generation":2}
45932024-11-14T00:33:53.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45942024-11-14T00:33:53.328ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45952024-11-14T00:33:53.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45962024-11-14T00:33:53.331ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45972024-11-14T00:33:53.332ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45982024-11-14T00:33:53.334ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 172.339585ms iteration = 31 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
45992024-11-14T00:33:53.335ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
46002024-11-14T00:33:53.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46012024-11-14T00:33:53.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46022024-11-14T00:33:53.336ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46032024-11-14T00:33:53.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46042024-11-14T00:33:53.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
46052024-11-14T00:33:53.338ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46062024-11-14T00:33:53.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46072024-11-14T00:33:53.344ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46082024-11-14T00:33:53.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46092024-11-14T00:33:53.345ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
46102024-11-14T00:33:53.345ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
46112024-11-14T00:33:53.345ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
46122024-11-14T00:33:53.345ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46132024-11-14T00:33:53.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46142024-11-14T00:33:53.346ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46152024-11-14T00:33:53.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46162024-11-14T00:33:53.347ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46172024-11-14T00:33:53.349ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46182024-11-14T00:33:53.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46192024-11-14T00:33:53.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46202024-11-14T00:33:53.352ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46212024-11-14T00:33:53.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46222024-11-14T00:33:53.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46232024-11-14T00:33:53.352ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46242024-11-14T00:33:53.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46252024-11-14T00:33:53.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: e211d163-be78-4663-b73f-baf5e9462a10, lookup_type: ById(e211d163-be78-4663-b73f-baf5e9462a10) } result = Ok(())
46262024-11-14T00:33:53.353ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46272024-11-14T00:33:53.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46282024-11-14T00:33:53.353ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
46292024-11-14T00:33:53.353ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 195.808415ms iteration = 91 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
46302024-11-14T00:33:53.355ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46312024-11-14T00:33:53.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46322024-11-14T00:33:53.355ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 196.708558ms iteration = 31 status = 0
46332024-11-14T00:33:53.356ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46342024-11-14T00:33:53.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46352024-11-14T00:33:53.358ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46362024-11-14T00:33:53.363ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
46372024-11-14T00:33:53.363ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46382024-11-14T00:33:53.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46392024-11-14T00:33:53.364ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46402024-11-14T00:33:53.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46412024-11-14T00:33:53.366ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
46422024-11-14T00:33:53.366ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
46432024-11-14T00:33:53.366ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 207.354798ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
46442024-11-14T00:33:53.377ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-14T00:18:50.724288Z, time_modified: 2024-11-14T00:18:50.724288Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, db_silo: Silo { identity: SiloIdentity { id: bf9014ac-edb7-4293-a1ff-4004060e0581, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T00:18:55.151722Z, time_modified: 2024-11-14T00:18:55.151722Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bf9014ac-edb7-4293-a1ff-4004060e0581, db_silo: Silo { identity: SiloIdentity { id: bf9014ac-edb7-4293-a1ff-4004060e0581, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-14T00:18:55.151722Z, time_modified: 2024-11-14T00:18:55.151722Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52" }] }) }
46452024-11-14T00:33:53.377ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 219.062092ms iteration = 17 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bf9014ac-edb7-4293-a1ff-4004060e0581","tls_certs":["0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52"]}},"default_endpoint":{"silo_id":"bf9014ac-edb7-4293-a1ff-4004060e0581","tls_certs":["0798a7385384103ed54567d8406210304cdb091736af57f4492a8d16af3f2d52"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
46462024-11-14T00:33:53.392ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
46472024-11-14T00:33:53.392ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 501e9987-47e9-4194-a5b0-10ee954fd76c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
46482024-11-14T00:33:53.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46492024-11-14T00:33:53.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46502024-11-14T00:33:53.401ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 242.37528ms iteration = 34 status = {"physical_disks_added":0}
46512024-11-14T00:33:53.421ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
46522024-11-14T00:33:53.440ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
46532024-11-14T00:33:53.440ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 280.71332ms iteration = 16 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
46542024-11-14T00:33:53.497ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46552024-11-14T00:33:53.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46562024-11-14T00:33:53.517ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 359.323556ms iteration = 31 status = {}
46572024-11-14T00:33:53.520ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
46582024-11-14T00:33:53.676ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
46592024-11-14T00:33:53.677ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ffeb3d1e-b538-45d9-81e7-af058f1603ac", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
46602024-11-14T00:33:53.677ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
46612024-11-14T00:33:53.678ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "dd6e835c-0c0e-4db9-9d43-15a1b38e7041", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
46622024-11-14T00:33:53.678ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
46632024-11-14T00:33:53.679ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "352024b7-f868-475b-b10b-d551094182db", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
46642024-11-14T00:33:53.679ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
46652024-11-14T00:33:53.681ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
46662024-11-14T00:33:53.681ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 523.75437ms iteration = 18 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
46672024-11-14T00:33:53.704ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 zone_address = fd00:1122:3344:101::2
46682024-11-14T00:33:53.704ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46692024-11-14T00:33:53.705ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cbae2e0-c9e9-41ad-a7d9-37507707168a", "content-length": "26", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} })
46702024-11-14T00:33:53.705ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46712024-11-14T00:33:53.707ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
46722024-11-14T00:33:53.778ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46732024-11-14T00:33:53.778ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7ea0e47-f24f-4c87-b806-2eb183d856f4", "content-length": "2", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} })
46742024-11-14T00:33:53.781ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46752024-11-14T00:33:53.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46762024-11-14T00:33:53.835ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
46772024-11-14T00:33:53.836ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ea4fc64f-ecdf-40a2-954a-8a5f7ddb9df0", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46782024-11-14T00:33:53.836ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46792024-11-14T00:33:53.837ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
46802024-11-14T00:33:53.837ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46812024-11-14T00:33:53.838ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "9fcdd48e-6c9e-478c-8646-4b35cdd7e47c", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46822024-11-14T00:33:53.838ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46832024-11-14T00:33:53.838ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a93b2a0-7953-4b1c-a9be-f99b5e8d8f89", "content-length": "372", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} })
46842024-11-14T00:33:53.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46852024-11-14T00:33:53.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46862024-11-14T00:33:53.839ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46872024-11-14T00:33:53.840ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46882024-11-14T00:33:53.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46892024-11-14T00:33:53.840ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46902024-11-14T00:33:53.840ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 682.502794ms iteration = 18 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
46912024-11-14T00:33:53.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46922024-11-14T00:33:53.841ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 683.64229ms iteration = 31 status = null
46932024-11-14T00:33:53.842ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46942024-11-14T00:33:53.842ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46952024-11-14T00:33:53.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46962024-11-14T00:33:53.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46972024-11-14T00:33:53.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46982024-11-14T00:33:53.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46992024-11-14T00:33:53.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47002024-11-14T00:33:53.846ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
47012024-11-14T00:33:53.846ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47022024-11-14T00:33:53.846ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 501e9987-47e9-4194-a5b0-10ee954fd76c dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
47032024-11-14T00:33:53.846ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
47042024-11-14T00:33:53.846ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-14 00:18:53.692551 UTC dns_group = internal generation = 1
47052024-11-14T00:33:53.846ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 688.367527ms iteration = 17 status = {"generation":1}
47062024-11-14T00:33:53.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47072024-11-14T00:33:53.851ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47082024-11-14T00:33:53.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47092024-11-14T00:33:53.852ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47102024-11-14T00:33:53.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47112024-11-14T00:33:53.855ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47122024-11-14T00:33:53.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47132024-11-14T00:33:53.857ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47142024-11-14T00:33:53.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47152024-11-14T00:33:53.859ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47162024-11-14T00:33:53.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47172024-11-14T00:33:53.861ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47182024-11-14T00:33:53.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47192024-11-14T00:33:53.862ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47202024-11-14T00:33:53.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47212024-11-14T00:33:53.864ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47222024-11-14T00:33:53.867ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
47232024-11-14T00:33:53.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47242024-11-14T00:33:53.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47252024-11-14T00:33:53.868ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47262024-11-14T00:33:53.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47272024-11-14T00:33:53.870ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47282024-11-14T00:33:53.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47292024-11-14T00:33:53.874ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47302024-11-14T00:33:53.875ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47312024-11-14T00:33:53.878ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47322024-11-14T00:33:53.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47332024-11-14T00:33:53.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47342024-11-14T00:33:53.879ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
47352024-11-14T00:33:53.879ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47362024-11-14T00:33:53.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47372024-11-14T00:33:53.886ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 00aec831-d913-453b-93f1-db7834b3ba0a, kind: Service { id: b501ed1c-871c-451e-b97c-1d88e152ca13 }, name: Name("nexus-b501ed1c-871c-451e-b97c-1d88e152ca13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67e7452d-53e4-483d-ba7c-2da9ca93cbfe, kind: Service { id: d06da591-b39e-4924-be5a-46bd48b9952b }, name: Name("nexus-d06da591-b39e-4924-be5a-46bd48b9952b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 704e6171-e764-4784-a8a3-2658310e6967, kind: Service { id: f6ae4a1b-61c3-453e-a52a-0df59bfd354a }, name: Name("nexus-f6ae4a1b-61c3-453e-a52a-0df59bfd354a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: ada907e9-c417-4c4d-bd0f-4151c324975c, kind: Service { id: df51b222-8234-4074-91c0-cdaaebfaa9a4 }, name: Name("external-dns-df51b222-8234-4074-91c0-cdaaebfaa9a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9b5acc-797c-470d-ab0d-4ccaeda589d1, kind: Service { id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184 }, name: Name("external-dns-6880e62c-aa82-46ed-8fbf-fcd0d42c3184"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
47382024-11-14T00:33:53.886ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47392024-11-14T00:33:53.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47402024-11-14T00:33:53.887ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
47412024-11-14T00:33:53.887ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
47422024-11-14T00:33:53.887ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "87c578db-e7cb-4203-9ec3-a618fcc6c3de", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} })
47432024-11-14T00:33:53.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47442024-11-14T00:33:53.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47452024-11-14T00:33:53.888ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47462024-11-14T00:33:53.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47472024-11-14T00:33:53.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47482024-11-14T00:33:53.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
47492024-11-14T00:33:53.891ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47502024-11-14T00:33:53.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47512024-11-14T00:33:53.892ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
47522024-11-14T00:33:53.892ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: ada907e9-c417-4c4d-bd0f-4151c324975c, kind: Service { id: df51b222-8234-4074-91c0-cdaaebfaa9a4 }, name: Name("external-dns-df51b222-8234-4074-91c0-cdaaebfaa9a4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 231, 88])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9b5acc-797c-470d-ab0d-4ccaeda589d1, kind: Service { id: 6880e62c-aa82-46ed-8fbf-fcd0d42c3184 }, name: Name("external-dns-6880e62c-aa82-46ed-8fbf-fcd0d42c3184"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 250])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 00aec831-d913-453b-93f1-db7834b3ba0a, kind: Service { id: b501ed1c-871c-451e-b97c-1d88e152ca13 }, name: Name("nexus-b501ed1c-871c-451e-b97c-1d88e152ca13"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 67e7452d-53e4-483d-ba7c-2da9ca93cbfe, kind: Service { id: d06da591-b39e-4924-be5a-46bd48b9952b }, name: Name("nexus-d06da591-b39e-4924-be5a-46bd48b9952b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 46])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 704e6171-e764-4784-a8a3-2658310e6967, kind: Service { id: f6ae4a1b-61c3-453e-a52a-0df59bfd354a }, name: Name("nexus-f6ae4a1b-61c3-453e-a52a-0df59bfd354a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 143])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
47532024-11-14T00:33:53.892ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
47542024-11-14T00:33:53.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47552024-11-14T00:33:53.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47562024-11-14T00:33:53.897ZINFOnexus (BackgroundTasks): VPC route manager sled e211d163-be78-4663-b73f-baf5e9462a10 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
47572024-11-14T00:33:53.897ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47582024-11-14T00:33:53.897ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8a529565-0cf3-46d6-816c-a9e1862b5c98", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} })
47592024-11-14T00:33:53.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47602024-11-14T00:33:53.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47612024-11-14T00:33:53.900ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 1b492b5b-8c3a-4e99-9528-5d52a91581c5, rack_id: fcfbb675-622a-4d07-9c7d-02f1c7317864, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b) } rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
47622024-11-14T00:33:53.900ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47632024-11-14T00:33:53.900ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 740.567181ms iteration = 35 status = {}
47642024-11-14T00:33:53.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47652024-11-14T00:33:53.913ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
47662024-11-14T00:33:53.913ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "51f42076-60d6-4c65-af83-22cb9be20607", "content-length": "134", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} })
47672024-11-14T00:33:53.913ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
47682024-11-14T00:33:53.913ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = d5fc9a38-ca99-44ad-95a3-d22ca6bdfc5b
47692024-11-14T00:33:53.913ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
47702024-11-14T00:33:53.913ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
47712024-11-14T00:33:53.913ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47722024-11-14T00:33:53.913ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47732024-11-14T00:33:53.913ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47742024-11-14T00:33:53.913ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47752024-11-14T00:33:53.914ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47762024-11-14T00:33:53.914ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47772024-11-14T00:33:53.914ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864
47782024-11-14T00:33:53.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47792024-11-14T00:33:53.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47802024-11-14T00:33:53.916ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
47812024-11-14T00:33:53.916ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "71387d20-e1e2-495e-a38e-0951af7652d4", "content-length": "2", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} })
47822024-11-14T00:33:53.916ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
47832024-11-14T00:33:53.916ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c1f40ec-0970-4bff-a5e7-8fcf2679bf37", "content-length": "52", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} })
47842024-11-14T00:33:53.916ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch_location = Switch0
47852024-11-14T00:33:53.916ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
47862024-11-14T00:33:53.954ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: e211d163-be78-4663-b73f-baf5e9462a10, time_created: 2024-11-14T00:18:53.213414Z, time_modified: 2024-11-14T00:18:53.213414Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: fcfbb675-622a-4d07-9c7d-02f1c7317864, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
47872024-11-14T00:33:53.954ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
47882024-11-14T00:33:53.954ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47892024-11-14T00:33:53.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47902024-11-14T00:33:53.956ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47912024-11-14T00:33:53.957ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47922024-11-14T00:33:53.958ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47932024-11-14T00:33:53.961ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: e211d163-be78-4663-b73f-baf5e9462a10, lookup_type: ById(e211d163-be78-4663-b73f-baf5e9462a10) } result = Ok(())
47942024-11-14T00:33:54.004ZDEBGnexus (BackgroundTasks): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
47952024-11-14T00:33:54.024ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
47962024-11-14T00:33:54.026ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7b61a75d-3a9c-4a3b-9a27-cf7c415ee859", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} })
47972024-11-14T00:33:54.026ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 switch = Switch0
47982024-11-14T00:33:54.026ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47992024-11-14T00:33:54.027ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fcfbb675-622a-4d07-9c7d-02f1c7317864 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3230b30-61f3-42f8-b79d-278e0eae27ec", "content-length": "682", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} })
48002024-11-14T00:33:54.027ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48012024-11-14T00:33:54.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48022024-11-14T00:33:54.027ZDEBGnexus (BackgroundTasks): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef5d3f6a-6dd2-4580-a8ee-63ff1066b849", "content-length": "691", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} })
48032024-11-14T00:33:54.027ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
48042024-11-14T00:33:54.027ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
48052024-11-14T00:33:54.027ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
48062024-11-14T00:33:54.029ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 870.271236ms iteration = 33 status = {}
48072024-11-14T00:33:54.031ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48082024-11-14T00:33:54.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48092024-11-14T00:33:54.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48102024-11-14T00:33:54.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48112024-11-14T00:33:54.034ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = e211d163-be78-4663-b73f-baf5e9462a10 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "23d85d4a-4e48-4ca8-93a7-1349ee263fae", "date": "Thu, 14 Nov 2024 00:33:53 GMT"} })
48122024-11-14T00:33:54.036ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
48132024-11-14T00:33:54.036ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 876.572215ms
48142024-11-14T00:33:54.036ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 876.579425ms iteration = 4 status = {}
48152024-11-14T00:33:54.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48162024-11-14T00:33:54.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48172024-11-14T00:33:54.044ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 885.821525ms iteration = 31 status = {}
48182024-11-14T00:33:56.405ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
48192024-11-14T00:33:56.405ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
48202024-11-14T00:33:56.435ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
48212024-11-14T00:33:56.435ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:45224
48222024-11-14T00:33:56.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:45224 req_id = e6311e14-faed-44c1-85ee-ae30b107a6f5 roles = RoleSet { roles: {} } uri = /metrics/producers
48232024-11-14T00:33:56.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:45224 req_id = e6311e14-faed-44c1-85ee-ae30b107a6f5 resource = Database result = Ok(()) uri = /metrics/producers
48242024-11-14T00:33:56.475ZINFOnexus: assigned collector to new producer collector_id = ad042fde-503a-4314-8c8c-afa2f783d145 file = nexus/src/app/oximeter.rs:76 producer_id = b501ed1c-871c-451e-b97c-1d88e152ca13
48252024-11-14T00:33:56.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40458 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:45224 req_id = e6311e14-faed-44c1-85ee-ae30b107a6f5 response_code = 201 uri = /metrics/producers
48262024-11-14T00:33:56.475ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "e6311e14-faed-44c1-85ee-ae30b107a6f5", "content-length": "41", "date": "Thu, 14 Nov 2024 00:33:56 GMT"} })
48272024-11-14T00:33:56.477ZDEBGnexus (producer-registration-task): registered with nexus successfully
48282024-11-14T00:33:56.477ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
48292024-11-14T00:34:00.950ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2070 local_addr = [fd00:1122:3344:101::a]:55319 method = GET remote_addr = [fd00:1122:3344:101::d]:54109 req_id = 98612b91-165b-44bd-b5f5-1ff5af855ebc response_code = 200 uri = /b501ed1c-871c-451e-b97c-1d88e152ca13
48302024-11-14T00:34:03.158ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 92 reason = Timeout
48312024-11-14T00:34:03.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48322024-11-14T00:34:03.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48332024-11-14T00:34:03.159ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 92 reason = Timeout
48342024-11-14T00:34:03.159ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48352024-11-14T00:34:03.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48362024-11-14T00:34:03.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48372024-11-14T00:34:03.161ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48382024-11-14T00:34:03.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48392024-11-14T00:34:03.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48402024-11-14T00:34:03.162ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48412024-11-14T00:34:03.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48422024-11-14T00:34:03.164ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48432024-11-14T00:34:03.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48442024-11-14T00:34:03.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48452024-11-14T00:34:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 6178f930-5fa8-46a0-8fe5-b460818f9d6f, lookup_type: ById(6178f930-5fa8-46a0-8fe5-b460818f9d6f) } result = Ok(())
48462024-11-14T00:34:03.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48472024-11-14T00:34:03.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48482024-11-14T00:34:03.179ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f original_time_created = 2024-11-14 00:18:47.526379 UTC target_id = 6178f930-5fa8-46a0-8fe5-b460818f9d6f time_created = 2024-11-14 00:18:47.526379 UTC
48492024-11-14T00:34:03.179ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.127257ms iteration = 92 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"6178f930-5fa8-46a0-8fe5-b460818f9d6f","time_created":"2024-11-14T00:18:47.526379Z"}
48502024-11-14T00:34:03.190ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.61479ms iteration = 92 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}