Max level shown:
12024-11-19T01:45:02.311ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
22024-11-19T01:45:02.311ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32024-11-19T01:45:02.312ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42024-11-19T01:45:02.314ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) } result = Ok(())
52024-11-19T01:45:02.314ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
62024-11-19T01:45:02.314ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
72024-11-19T01:45:02.316ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
82024-11-19T01:45:02.316ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
92024-11-19T01:45:02.318ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
102024-11-19T01:45:02.318ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
112024-11-19T01:45:02.319ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
122024-11-19T01:45:02.320ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
132024-11-19T01:45:02.322ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
142024-11-19T01:45:02.323ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
152024-11-19T01:45:02.325ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
162024-11-19T01:45:02.325ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
172024-11-19T01:45:02.327ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
182024-11-19T01:45:02.327ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
192024-11-19T01:45:02.330ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
202024-11-19T01:45:02.333ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ByName("instance-ab8d5c5749") } result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
212024-11-19T01:45:02.333ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
222024-11-19T01:45:02.333ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
232024-11-19T01:45:02.336ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
242024-11-19T01:45:02.336ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
252024-11-19T01:45:02.339ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
262024-11-19T01:45:02.339ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
272024-11-19T01:45:02.342ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
282024-11-19T01:45:02.342ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
292024-11-19T01:45:02.343ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
302024-11-19T01:45:02.346ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ByName("instance-ab8d5c5749") } result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
312024-11-19T01:45:02.346ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
322024-11-19T01:45:02.346ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
332024-11-19T01:45:02.382ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148139 local_addr = 172.30.2.5:443 method = GET remote_addr = 10.151.1.100:46800 req_id = 7c774014-96b8-401f-a0cc-5066dc4bf714 response_code = 200 uri = /v1/instances/instance-ab8d5c5749/serial-console?max_bytes=1048576&most_recent=1048576&project=proj-b2f4478829e
342024-11-19T01:45:02.874ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
352024-11-19T01:45:02.875ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
362024-11-19T01:45:02.876ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
372024-11-19T01:45:02.877ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
382024-11-19T01:45:02.878ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
392024-11-19T01:45:02.880ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("token = \\"2cf93d2e93fb282cf3086910605871c6c790ce41\\"") } result = Ok(())
402024-11-19T01:45:02.880ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
412024-11-19T01:45:02.880ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
422024-11-19T01:45:02.882ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
432024-11-19T01:45:02.882ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
442024-11-19T01:45:02.884ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
452024-11-19T01:45:02.884ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
462024-11-19T01:45:02.885ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
472024-11-19T01:45:02.886ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
482024-11-19T01:45:02.887ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
492024-11-19T01:45:02.889ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
502024-11-19T01:45:02.889ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
512024-11-19T01:45:02.889ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
522024-11-19T01:45:02.890ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
532024-11-19T01:45:02.891ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("2cf93d2e93fb282cf3086910605871c6c790ce41") } result = Ok(())
542024-11-19T01:45:02.891ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
552024-11-19T01:45:02.892ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
562024-11-19T01:45:02.898ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
572024-11-19T01:45:02.899ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
582024-11-19T01:45:02.900ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
592024-11-19T01:45:02.900ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
602024-11-19T01:45:02.901ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
612024-11-19T01:45:02.902ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
622024-11-19T01:45:02.903ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
632024-11-19T01:45:02.903ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
642024-11-19T01:45:02.905ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
652024-11-19T01:45:02.906ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
662024-11-19T01:45:02.906ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
672024-11-19T01:45:02.906ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
682024-11-19T01:45:02.907ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
692024-11-19T01:45:02.907ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
702024-11-19T01:45:02.908ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
712024-11-19T01:45:02.908ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
722024-11-19T01:45:02.909ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
732024-11-19T01:45:02.911ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) } result = Ok(())
742024-11-19T01:45:02.911ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
752024-11-19T01:45:02.911ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
762024-11-19T01:45:02.912ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
772024-11-19T01:45:02.912ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
782024-11-19T01:45:02.914ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
792024-11-19T01:45:02.914ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
802024-11-19T01:45:02.916ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
812024-11-19T01:45:02.916ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
822024-11-19T01:45:02.918ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
832024-11-19T01:45:02.918ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
842024-11-19T01:45:02.921ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
852024-11-19T01:45:02.921ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
862024-11-19T01:45:02.923ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
872024-11-19T01:45:02.923ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
882024-11-19T01:45:02.926ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
892024-11-19T01:45:02.928ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ByName("instance-ab8d5c5749") } result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
902024-11-19T01:45:02.928ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
912024-11-19T01:45:02.928ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
922024-11-19T01:45:02.930ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
932024-11-19T01:45:02.931ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
942024-11-19T01:45:02.932ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
952024-11-19T01:45:02.932ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
962024-11-19T01:45:02.935ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
972024-11-19T01:45:02.935ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
982024-11-19T01:45:02.937ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
992024-11-19T01:45:02.940ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ByName("instance-ab8d5c5749") } result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1002024-11-19T01:45:02.940ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1012024-11-19T01:45:02.940ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1022024-11-19T01:45:02.942ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
1032024-11-19T01:45:02.943ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
1042024-11-19T01:45:02.944ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
1052024-11-19T01:45:02.945ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
1062024-11-19T01:45:02.946ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
1072024-11-19T01:45:02.947ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: 302245ee-8785-4baf-86ed-0823410907ec, lookup_type: ById(302245ee-8785-4baf-86ed-0823410907ec) } result = Ok(())
1082024-11-19T01:45:02.977ZDEBGnexus: client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vmms/f29067fd-e978-4a5d-8f3c-f6f062710092/state
1092024-11-19T01:45:02.979ZDEBGnexus: client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/f29067fd-e978-4a5d-8f3c-f6f062710092/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "1903123e-971e-43b7-abbb-65860501c6ed", "content-length": "151", "date": "Tue, 19 Nov 2024 01:45:02 GMT"} })
1102024-11-19T01:45:02.979ZINFOnexus (dropshot_external): received new VMM runtime state from sled agent actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true file = nexus/src/app/instance.rs:2151 local_addr = 172.30.2.5:443 method = POST migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-11-19T01:45:02.979286454Z }
1112024-11-19T01:45:02.979ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1122024-11-19T01:45:02.979ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1132024-11-19T01:45:02.998ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1142024-11-19T01:45:02.999ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1152024-11-19T01:45:03.001ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1162024-11-19T01:45:03.001ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1172024-11-19T01:45:03.004ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1182024-11-19T01:45:03.004ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1192024-11-19T01:45:03.007ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1202024-11-19T01:45:03.007ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1212024-11-19T01:45:03.009ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1222024-11-19T01:45:03.012ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ByName("instance-ab8d5c5749") } result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1232024-11-19T01:45:03.012ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1242024-11-19T01:45:03.012ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1252024-11-19T01:45:03.015ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140545 local_addr = 172.30.2.5:443 method = POST remote_addr = 10.151.1.100:46800 req_id = 248049b4-c9e3-4497-a16f-21f9295551c8 response_code = 202 uri = /v1/instances/instance-ab8d5c5749/stop?project=proj-b2f4478829e
1262024-11-19T01:45:03.016ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1272024-11-19T01:45:03.016ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1282024-11-19T01:45:03.017ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1292024-11-19T01:45:03.018ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1302024-11-19T01:45:03.019ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1312024-11-19T01:45:03.020ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("token = \\"2cf93d2e93fb282cf3086910605871c6c790ce41\\"") } result = Ok(())
1322024-11-19T01:45:03.020ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1332024-11-19T01:45:03.020ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1342024-11-19T01:45:03.022ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1352024-11-19T01:45:03.022ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1362024-11-19T01:45:03.024ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1372024-11-19T01:45:03.024ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1382024-11-19T01:45:03.025ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1392024-11-19T01:45:03.025ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1402024-11-19T01:45:03.027ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1412024-11-19T01:45:03.028ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
1422024-11-19T01:45:03.028ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1432024-11-19T01:45:03.028ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1442024-11-19T01:45:03.030ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1452024-11-19T01:45:03.031ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("2cf93d2e93fb282cf3086910605871c6c790ce41") } result = Ok(())
1462024-11-19T01:45:03.031ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1472024-11-19T01:45:03.031ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1482024-11-19T01:45:03.035ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1492024-11-19T01:45:03.036ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1502024-11-19T01:45:03.037ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1512024-11-19T01:45:03.037ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1522024-11-19T01:45:03.038ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1532024-11-19T01:45:03.038ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1542024-11-19T01:45:03.040ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1552024-11-19T01:45:03.040ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1562024-11-19T01:45:03.041ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1572024-11-19T01:45:03.042ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
1582024-11-19T01:45:03.042ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1592024-11-19T01:45:03.042ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1602024-11-19T01:45:03.043ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1612024-11-19T01:45:03.044ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1622024-11-19T01:45:03.045ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1632024-11-19T01:45:03.045ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1642024-11-19T01:45:03.046ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1652024-11-19T01:45:03.047ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) } result = Ok(())
1662024-11-19T01:45:03.047ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1672024-11-19T01:45:03.047ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1682024-11-19T01:45:03.048ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1692024-11-19T01:45:03.049ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1702024-11-19T01:45:03.050ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1712024-11-19T01:45:03.051ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1722024-11-19T01:45:03.053ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1732024-11-19T01:45:03.053ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1742024-11-19T01:45:03.055ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1752024-11-19T01:45:03.055ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1762024-11-19T01:45:03.058ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1772024-11-19T01:45:03.058ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1782024-11-19T01:45:03.060ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1792024-11-19T01:45:03.060ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1802024-11-19T01:45:03.063ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1812024-11-19T01:45:03.065ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ByName("instance-ab8d5c5749") } result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
1822024-11-19T01:45:03.065ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
1832024-11-19T01:45:03.065ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
1842024-11-19T01:45:03.067ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
1852024-11-19T01:45:03.068ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
1862024-11-19T01:45:03.068ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
1872024-11-19T01:45:03.068ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
1882024-11-19T01:45:03.073ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete
1892024-11-19T01:45:03.073ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a","lookup_type":{"ByName":"instance-ab8d5c5749"},"parent":{"key":"43ed357a-1904-4080-ab4e-07192398e688","lookup_type":{"ByName":"proj-b2f4478829e"},"parent":{"key":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa","lookup_type":{"ById":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"86a86001-384a-4275-bd9e-a066e76750a7","hostname":"localshark","identity":{"description":"","id":"9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a","name":"instance-ab8d5c5749","time_created":"2024-11-19T01:44:42.710477Z","time_deleted":null,"time_modified":"2024-11-19T01:44:42.710477Z"},"memory":1073741824,"ncpus":2,"project_id":"43ed357a-1904-4080-ab4e-07192398e688","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"f29067fd-e978-4a5d-8f3c-f6f062710092","time_last_auto_restarted":null,"time_updated":"2024-11-19T01:44:42.710477Z"},"updater_gen":1,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa","silo_user_id":"b2fcdebd-1828-4cea-80ef-2c95bec46fd5"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
1902024-11-19T01:45:03.073ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete
1912024-11-19T01:45:03.077ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete
1922024-11-19T01:45:03.077ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
1932024-11-19T01:45:03.077ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
1942024-11-19T01:45:03.077ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab
1952024-11-19T01:45:03.081ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
1962024-11-19T01:45:03.081ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab
1972024-11-19T01:45:03.085ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
1982024-11-19T01:45:03.085ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab
1992024-11-19T01:45:03.088ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2002024-11-19T01:45:03.089ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2012024-11-19T01:45:03.090ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2022024-11-19T01:45:03.090ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2032024-11-19T01:45:03.092ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2042024-11-19T01:45:03.092ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2052024-11-19T01:45:03.093ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2062024-11-19T01:45:03.094ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2072024-11-19T01:45:03.096ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2082024-11-19T01:45:03.096ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2092024-11-19T01:45:03.099ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2102024-11-19T01:45:03.099ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2112024-11-19T01:45:03.100ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2122024-11-19T01:45:03.101ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2132024-11-19T01:45:03.103ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2142024-11-19T01:45:03.106ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ById(43ed357a-1904-4080-ab4e-07192398e688) }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ById(9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a) } result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2152024-11-19T01:45:03.106ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a
2162024-11-19T01:45:03.106ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2172024-11-19T01:45:03.106ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2182024-11-19T01:45:03.108ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2192024-11-19T01:45:03.108ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2202024-11-19T01:45:03.121ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2212024-11-19T01:45:03.121ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteNat
2222024-11-19T01:45:03.135ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
2232024-11-19T01:45:03.135ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
2242024-11-19T01:45:03.136ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
2252024-11-19T01:45:03.138ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
2262024-11-19T01:45:03.138ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
2272024-11-19T01:45:03.138ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
2282024-11-19T01:45:03.141ZDEBGnexus: notifying dendrite of updates instance_id = Some(9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a (instance)) switch = switch0
2292024-11-19T01:45:03.142ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1753, tv_nsec: 309910810 } })
2302024-11-19T01:45:03.142ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
2312024-11-19T01:45:03.175ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
2322024-11-19T01:45:03.175ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2332024-11-19T01:45:03.175ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d20f1145-3076-415e-a570-c6f2e995bc87", "content-length": "26", "date": "Tue, 19 Nov 2024 01:45:03 GMT"} })
2342024-11-19T01:45:03.175ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2352024-11-19T01:45:03.176ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2362024-11-19T01:45:03.204ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
2372024-11-19T01:45:03.205ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "d73aa190-4ab8-49fa-a172-4d9ccaf28157", "content-length": "4", "date": "Tue, 19 Nov 2024 01:45:02 GMT"} })
2382024-11-19T01:45:03.206ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
2392024-11-19T01:45:03.207ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab
2402024-11-19T01:45:03.210ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
2412024-11-19T01:45:03.210ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab
2422024-11-19T01:45:03.214ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteRecord
2432024-11-19T01:45:03.214ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteRecord
2442024-11-19T01:45:03.219ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteRecord
2452024-11-19T01:45:03.219ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteRecord
2462024-11-19T01:45:03.221ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteRecord
2472024-11-19T01:45:03.221ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteRecord
2482024-11-19T01:45:03.224ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteRecord
2492024-11-19T01:45:03.224ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteRecord
2502024-11-19T01:45:03.227ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteRecord
2512024-11-19T01:45:03.229ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ByName("instance-ab8d5c5749") } result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteRecord
2522024-11-19T01:45:03.229ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteRecord
2532024-11-19T01:45:03.230ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_node = InstanceDeleteRecord
2542024-11-19T01:45:03.245ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
2552024-11-19T01:45:03.245ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab
2562024-11-19T01:45:03.249ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
2572024-11-19T01:45:03.249ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = unwinding saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab
2582024-11-19T01:45:03.257ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
2592024-11-19T01:45:03.257ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab
2602024-11-19T01:45:03.263ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
2612024-11-19T01:45:03.263ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab
2622024-11-19T01:45:03.267ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
2632024-11-19T01:45:03.267ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab
2642024-11-19T01:45:03.270ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
2652024-11-19T01:45:03.270ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab
2662024-11-19T01:45:03.273ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
2672024-11-19T01:45:03.273ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab
2682024-11-19T01:45:03.280ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b undo_result = success
2692024-11-19T01:45:03.280ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = e99fca13-9db6-41f3-baf9-280aa8a964ab saga_name = instance-delete saga_result = SagaResult { saga_id: e99fca13-9db6-41f3-baf9-280aa8a964ab, saga_log: SagaLog { saga_id: e99fca13-9db6-41f3-baf9-280aa8a964ab, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
2702024-11-19T01:45:03.283ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 266919 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f109c460-7286-4a4a-bbd9-a297caec51ae response_code = 400 uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
2712024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
2722024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
2732024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2742024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
2752024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
2762024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
2772024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2782024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
2792024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
2802024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2812024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
2822024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
2832024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
2842024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2852024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2862024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2872024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2882024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2892024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2902024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
2912024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2922024-11-19T01:45:04.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2932024-11-19T01:45:04.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
2942024-11-19T01:45:04.236ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
2952024-11-19T01:45:04.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2962024-11-19T01:45:04.236ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
2972024-11-19T01:45:04.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2982024-11-19T01:45:04.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
2992024-11-19T01:45:04.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3002024-11-19T01:45:04.236ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
3012024-11-19T01:45:04.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
3022024-11-19T01:45:04.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3032024-11-19T01:45:04.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
3042024-11-19T01:45:04.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3052024-11-19T01:45:04.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
3062024-11-19T01:45:04.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3072024-11-19T01:45:04.237ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.788809ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
3082024-11-19T01:45:04.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3092024-11-19T01:45:04.238ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
3102024-11-19T01:45:04.238ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
3112024-11-19T01:45:04.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3122024-11-19T01:45:04.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3132024-11-19T01:45:04.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3142024-11-19T01:45:04.238ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1754, tv_nsec: 406202255 } })
3152024-11-19T01:45:04.238ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
3162024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
3172024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
3182024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
3192024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3202024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
3212024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
3222024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
3232024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3242024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
3252024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3262024-11-19T01:45:04.239ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1754, tv_nsec: 407411747 } })
3272024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
3282024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3292024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
3302024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3312024-11-19T01:45:04.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3322024-11-19T01:45:04.240ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
3332024-11-19T01:45:04.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3342024-11-19T01:45:04.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3352024-11-19T01:45:04.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3362024-11-19T01:45:04.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
3372024-11-19T01:45:04.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3382024-11-19T01:45:04.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3392024-11-19T01:45:04.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3402024-11-19T01:45:04.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3412024-11-19T01:45:04.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3422024-11-19T01:45:04.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3432024-11-19T01:45:04.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3442024-11-19T01:45:04.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3452024-11-19T01:45:04.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3462024-11-19T01:45:04.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
3472024-11-19T01:45:04.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
3482024-11-19T01:45:04.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
3492024-11-19T01:45:04.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3502024-11-19T01:45:04.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.140668ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
3512024-11-19T01:45:04.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3522024-11-19T01:45:04.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3532024-11-19T01:45:04.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3542024-11-19T01:45:04.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
3552024-11-19T01:45:04.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
3562024-11-19T01:45:04.250ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1754, tv_nsec: 418340392 } })
3572024-11-19T01:45:04.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49
3582024-11-19T01:45:04.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3592024-11-19T01:45:04.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3602024-11-19T01:45:04.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3612024-11-19T01:45:04.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3622024-11-19T01:45:04.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3632024-11-19T01:45:04.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3642024-11-19T01:45:04.255ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3652024-11-19T01:45:04.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
3662024-11-19T01:45:04.257ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3672024-11-19T01:45:04.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3682024-11-19T01:45:04.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3692024-11-19T01:45:04.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3702024-11-19T01:45:04.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
3712024-11-19T01:45:04.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
3722024-11-19T01:45:04.277ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3732024-11-19T01:45:04.277ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3742024-11-19T01:45:04.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3752024-11-19T01:45:04.277ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 41.115126ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
3762024-11-19T01:45:04.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3772024-11-19T01:45:04.278ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
3782024-11-19T01:45:04.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
3792024-11-19T01:45:04.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3802024-11-19T01:45:04.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 302245ee-8785-4baf-86ed-0823410907ec, lookup_type: ById(302245ee-8785-4baf-86ed-0823410907ec) } result = Ok(())
3812024-11-19T01:45:04.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3822024-11-19T01:45:04.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3832024-11-19T01:45:04.282ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 43.270234ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3842024-11-19T01:45:04.283ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 48.262503ms iteration = 26 status = 0
3852024-11-19T01:45:04.283ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
3862024-11-19T01:45:04.283ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
3872024-11-19T01:45:04.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3882024-11-19T01:45:04.283ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3892024-11-19T01:45:04.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3902024-11-19T01:45:04.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3912024-11-19T01:45:04.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3922024-11-19T01:45:04.285ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3932024-11-19T01:45:04.285ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
3942024-11-19T01:45:04.285ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3952024-11-19T01:45:04.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3962024-11-19T01:45:04.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3972024-11-19T01:45:04.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3982024-11-19T01:45:04.287ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
3992024-11-19T01:45:04.287ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4002024-11-19T01:45:04.287ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.316114ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
4012024-11-19T01:45:04.288ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 42cc80b5-1c54-4919-b680-9adaa2eee120, lookup_type: ById(42cc80b5-1c54-4919-b680-9adaa2eee120) } result = Ok(())
4022024-11-19T01:45:04.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4032024-11-19T01:45:04.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4042024-11-19T01:45:04.289ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4052024-11-19T01:45:04.290ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.285521ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4062024-11-19T01:45:04.290ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("token = \\"2cf93d2e93fb282cf3086910605871c6c790ce41\\"") } result = Ok(())
4072024-11-19T01:45:04.290ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4082024-11-19T01:45:04.290ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4092024-11-19T01:45:04.291ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4102024-11-19T01:45:04.291ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4112024-11-19T01:45:04.293ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4122024-11-19T01:45:04.293ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4132024-11-19T01:45:04.294ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4142024-11-19T01:45:04.295ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4152024-11-19T01:45:04.299ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4162024-11-19T01:45:04.301ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
4172024-11-19T01:45:04.301ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4182024-11-19T01:45:04.301ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4192024-11-19T01:45:04.301ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 original_time_created = 2024-11-19 01:32:24.851324 UTC target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 time_created = 2024-11-19 01:32:24.851324 UTC
4202024-11-19T01:45:04.301ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.162973ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"42cc80b5-1c54-4919-b680-9adaa2eee120","time_created":"2024-11-19T01:32:24.851324Z"}
4212024-11-19T01:45:04.302ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4222024-11-19T01:45:04.304ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("2cf93d2e93fb282cf3086910605871c6c790ce41") } result = Ok(())
4232024-11-19T01:45:04.304ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4242024-11-19T01:45:04.304ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4252024-11-19T01:45:04.311ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 72.330993ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
4262024-11-19T01:45:04.315ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4272024-11-19T01:45:04.315ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
4282024-11-19T01:45:04.315ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4292024-11-19T01:45:04.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4302024-11-19T01:45:04.344ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
4312024-11-19T01:45:04.344ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4322024-11-19T01:45:04.344ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "12e1851b-2b19-4097-affa-cdf2d80bb57f", "content-length": "26", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
4332024-11-19T01:45:04.344ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4342024-11-19T01:45:04.344ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
4352024-11-19T01:45:04.344ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4362024-11-19T01:45:04.344ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8aa59d7-2db7-4982-b8b0-97c4dc09b73e", "content-length": "26", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
4372024-11-19T01:45:04.344ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4382024-11-19T01:45:04.346ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4392024-11-19T01:45:04.347ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4402024-11-19T01:45:04.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4412024-11-19T01:45:04.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4422024-11-19T01:45:04.361ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 126.115425ms iteration = 28 status = {"physical_disks_added":0}
4432024-11-19T01:45:04.474ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 zone_address = fd00:1122:3344:101::2
4442024-11-19T01:45:04.474ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4452024-11-19T01:45:04.474ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "923d27ed-9204-4505-b323-b2a4af50b69d", "content-length": "26", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
4462024-11-19T01:45:04.474ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4472024-11-19T01:45:04.476ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49
4482024-11-19T01:45:04.486ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4492024-11-19T01:45:04.486ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8529a12-b985-4179-91ee-a2bedf10fcf3", "content-length": "2", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
4502024-11-19T01:45:04.488ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4512024-11-19T01:45:04.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4522024-11-19T01:45:04.501ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/f29067fd-e978-4a5d-8f3c-f6f062710092/state
4532024-11-19T01:45:04.503ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4542024-11-19T01:45:04.504ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 269.113362ms iteration = 26 status = null
4552024-11-19T01:45:04.504ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4562024-11-19T01:45:04.504ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4572024-11-19T01:45:04.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4582024-11-19T01:45:04.505ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4592024-11-19T01:45:04.506ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4602024-11-19T01:45:04.506ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4612024-11-19T01:45:04.510ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4622024-11-19T01:45:04.510ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4632024-11-19T01:45:04.511ZINFOnexus (BackgroundTasks): VPC route manager sled 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4642024-11-19T01:45:04.511ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4652024-11-19T01:45:04.511ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5e87b54-a119-48a2-8402-536c01ecaed4", "content-length": "585", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
4662024-11-19T01:45:04.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4672024-11-19T01:45:04.511ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4682024-11-19T01:45:04.511ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4692024-11-19T01:45:04.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4702024-11-19T01:45:04.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4712024-11-19T01:45:04.512ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4722024-11-19T01:45:04.513ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4732024-11-19T01:45:04.514ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4742024-11-19T01:45:04.514ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4752024-11-19T01:45:04.515ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4762024-11-19T01:45:04.517ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
4772024-11-19T01:45:04.517ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4782024-11-19T01:45:04.517ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4792024-11-19T01:45:04.518ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4802024-11-19T01:45:04.518ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4812024-11-19T01:45:04.519ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
4822024-11-19T01:45:04.519ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
4832024-11-19T01:45:04.525ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {1bf5f9af-1594-4e08-8b77-efe08afaca00: {10.151.1.176: {425ca83c-cc06-4aed-b1b3-e1eae15d7447}, 10.151.1.175: {425ca83c-cc06-4aed-b1b3-e1eae15d7447}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
4842024-11-19T01:45:04.525ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
4852024-11-19T01:45:04.526ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b98c934a-2a6d-4702-b46e-898296cca111", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
4862024-11-19T01:45:04.526ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4872024-11-19T01:45:04.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4882024-11-19T01:45:04.537ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4892024-11-19T01:45:04.537ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
4902024-11-19T01:45:04.537ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 301.255537ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
4912024-11-19T01:45:04.540ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 304.829941ms iteration = 26 status = {}
4922024-11-19T01:45:04.581ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4932024-11-19T01:45:04.581ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0d2b1f9-5930-499c-abf5-8409f78a175e", "content-length": "811", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
4942024-11-19T01:45:04.581ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(10299830) }} sled = buskin
4952024-11-19T01:45:04.581ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
4962024-11-19T01:45:04.581ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
4972024-11-19T01:45:04.582ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 347.110517ms iteration = 27 status = {}
4982024-11-19T01:45:04.582ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
4992024-11-19T01:45:04.583ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) } result = Ok(())
5002024-11-19T01:45:04.583ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5012024-11-19T01:45:04.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5022024-11-19T01:45:04.584ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5032024-11-19T01:45:04.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5042024-11-19T01:45:04.585ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5052024-11-19T01:45:04.585ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5062024-11-19T01:45:04.587ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5072024-11-19T01:45:04.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5082024-11-19T01:45:04.587ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5092024-11-19T01:45:04.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5102024-11-19T01:45:04.589ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5112024-11-19T01:45:04.589ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5122024-11-19T01:45:04.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5132024-11-19T01:45:04.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5142024-11-19T01:45:04.591ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5152024-11-19T01:45:04.591ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5162024-11-19T01:45:04.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5172024-11-19T01:45:04.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5182024-11-19T01:45:04.593ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5192024-11-19T01:45:04.593ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5202024-11-19T01:45:04.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5212024-11-19T01:45:04.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5222024-11-19T01:45:04.595ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5232024-11-19T01:45:04.595ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5242024-11-19T01:45:04.597ZINFOnexus (BackgroundTasks): VPC route manager sled 302245ee-8785-4baf-86ed-0823410907ec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
5252024-11-19T01:45:04.597ZINFOnexus (BackgroundTasks): VPC route manager sled 302245ee-8785-4baf-86ed-0823410907ec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
5262024-11-19T01:45:04.597ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
5272024-11-19T01:45:04.597ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b3421071-d6dc-4f18-8408-3ae4fedcd897", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
5282024-11-19T01:45:04.597ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5292024-11-19T01:45:04.599ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 360.865613ms iteration = 27 status = {}
5302024-11-19T01:45:04.600ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ByName("instance-ab8d5c5749") } result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
5312024-11-19T01:45:04.600ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5322024-11-19T01:45:04.600ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
5332024-11-19T01:45:04.601ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
5342024-11-19T01:45:04.602ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
5352024-11-19T01:45:04.602ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5362024-11-19T01:45:04.602ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
5372024-11-19T01:45:04.605ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete
5382024-11-19T01:45:04.605ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a","lookup_type":{"ByName":"instance-ab8d5c5749"},"parent":{"key":"43ed357a-1904-4080-ab4e-07192398e688","lookup_type":{"ByName":"proj-b2f4478829e"},"parent":{"key":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa","lookup_type":{"ById":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"86a86001-384a-4275-bd9e-a066e76750a7","hostname":"localshark","identity":{"description":"","id":"9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a","name":"instance-ab8d5c5749","time_created":"2024-11-19T01:44:42.710477Z","time_deleted":null,"time_modified":"2024-11-19T01:44:42.710477Z"},"memory":1073741824,"ncpus":2,"project_id":"43ed357a-1904-4080-ab4e-07192398e688","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"f29067fd-e978-4a5d-8f3c-f6f062710092","time_last_auto_restarted":null,"time_updated":"2024-11-19T01:44:42.710477Z"},"updater_gen":1,"updater_id":null,"user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa","silo_user_id":"b2fcdebd-1828-4cea-80ef-2c95bec46fd5"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
5392024-11-19T01:45:04.605ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete
5402024-11-19T01:45:04.609ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete
5412024-11-19T01:45:04.609ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
5422024-11-19T01:45:04.609ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
5432024-11-19T01:45:04.609ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a
5442024-11-19T01:45:04.613ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
5452024-11-19T01:45:04.613ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a
5462024-11-19T01:45:04.617ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
5472024-11-19T01:45:04.617ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a
5482024-11-19T01:45:04.620ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5492024-11-19T01:45:04.620ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5502024-11-19T01:45:04.621ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5512024-11-19T01:45:04.622ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5522024-11-19T01:45:04.623ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5532024-11-19T01:45:04.623ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5542024-11-19T01:45:04.624ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5552024-11-19T01:45:04.625ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5562024-11-19T01:45:04.627ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5572024-11-19T01:45:04.627ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5582024-11-19T01:45:04.629ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5592024-11-19T01:45:04.629ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5602024-11-19T01:45:04.630ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5612024-11-19T01:45:04.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5622024-11-19T01:45:04.631ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5632024-11-19T01:45:04.631ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5642024-11-19T01:45:04.632ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2ed5d87d-b512-430b-8a9f-5bee05700135, rack_id: cbab7bfb-8e8e-44f1-a93b-b95de3b50f49, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a8b5b6ed-8c4b-4b6d-a2dc-17e991abb0cd) } rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch_location = Switch0
5652024-11-19T01:45:04.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5662024-11-19T01:45:04.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5672024-11-19T01:45:04.634ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5682024-11-19T01:45:04.636ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ById(43ed357a-1904-4080-ab4e-07192398e688) }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ById(9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a) } result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5692024-11-19T01:45:04.636ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a
5702024-11-19T01:45:04.636ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5712024-11-19T01:45:04.636ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5722024-11-19T01:45:04.640ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5732024-11-19T01:45:04.640ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5742024-11-19T01:45:04.641ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
5752024-11-19T01:45:04.641ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "fad9ea18-2ec6-44a0-976d-29eb809965db", "content-length": "134", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
5762024-11-19T01:45:04.641ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
5772024-11-19T01:45:04.641ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a8b5b6ed-8c4b-4b6d-a2dc-17e991abb0cd
5782024-11-19T01:45:04.642ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
5792024-11-19T01:45:04.642ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5802024-11-19T01:45:04.642ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
5812024-11-19T01:45:04.642ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5822024-11-19T01:45:04.642ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5832024-11-19T01:45:04.642ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5842024-11-19T01:45:04.642ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5852024-11-19T01:45:04.642ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5862024-11-19T01:45:04.642ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteNat
5872024-11-19T01:45:04.642ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5882024-11-19T01:45:04.642ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5892024-11-19T01:45:04.642ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49
5902024-11-19T01:45:04.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5912024-11-19T01:45:04.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5922024-11-19T01:45:04.644ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
5932024-11-19T01:45:04.644ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
5942024-11-19T01:45:04.644ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
5952024-11-19T01:45:04.644ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
5962024-11-19T01:45:04.644ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c65d8d28-3b70-4071-ba00-4f92a5c4d32c", "content-length": "2", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
5972024-11-19T01:45:04.644ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
5982024-11-19T01:45:04.645ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ba8041d-d5e3-42a3-8ba5-eba008fddef8", "content-length": "51", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
5992024-11-19T01:45:04.645ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch_location = Switch0
6002024-11-19T01:45:04.645ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
6012024-11-19T01:45:04.645ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
6022024-11-19T01:45:04.647ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
6032024-11-19T01:45:04.647ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
6042024-11-19T01:45:04.647ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
6052024-11-19T01:45:04.653ZDEBGnexus: notifying dendrite of updates instance_id = Some(9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a (instance)) switch = switch0
6062024-11-19T01:45:04.653ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1754, tv_nsec: 821036033 } })
6072024-11-19T01:45:04.653ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
6082024-11-19T01:45:04.684ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
6092024-11-19T01:45:04.684ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6102024-11-19T01:45:04.684ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f72ad1dd-e550-45e5-b0b0-0ccd9d91a3e4", "content-length": "26", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
6112024-11-19T01:45:04.684ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6122024-11-19T01:45:04.685ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6132024-11-19T01:45:04.714ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
6142024-11-19T01:45:04.714ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ca2088f-29d2-444a-90a3-c0f5660e0ea4", "content-length": "4", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
6152024-11-19T01:45:04.716ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
6162024-11-19T01:45:04.716ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a
6172024-11-19T01:45:04.720ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
6182024-11-19T01:45:04.720ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a
6192024-11-19T01:45:04.724ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteRecord
6202024-11-19T01:45:04.725ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteRecord
6212024-11-19T01:45:04.727ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteRecord
6222024-11-19T01:45:04.727ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteRecord
6232024-11-19T01:45:04.730ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteRecord
6242024-11-19T01:45:04.730ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteRecord
6252024-11-19T01:45:04.732ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteRecord
6262024-11-19T01:45:04.732ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteRecord
6272024-11-19T01:45:04.734ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteRecord
6282024-11-19T01:45:04.737ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ByName("instance-ab8d5c5749") } result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteRecord
6292024-11-19T01:45:04.737ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteRecord
6302024-11-19T01:45:04.737ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_node = InstanceDeleteRecord
6312024-11-19T01:45:04.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7bb4ad42-727c-4258-ad68-f2332caae3c5", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
6322024-11-19T01:45:04.755ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch = Switch0
6332024-11-19T01:45:04.755ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
6342024-11-19T01:45:04.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1eed10b8-0f33-4941-a119-af8abe71055a", "content-length": "682", "date": "Tue, 19 Nov 2024 01:45:04 GMT"} })
6352024-11-19T01:45:04.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6362024-11-19T01:45:04.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6372024-11-19T01:45:04.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6382024-11-19T01:45:04.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6392024-11-19T01:45:04.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6402024-11-19T01:45:04.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6412024-11-19T01:45:04.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6422024-11-19T01:45:04.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6432024-11-19T01:45:04.773ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 537.910538ms iteration = 26 status = {}
6442024-11-19T01:45:04.815ZDEBGnexus (SEC): saga log event new_state = N001 failed sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
6452024-11-19T01:45:04.815ZDEBGnexus (SecStore): recording saga event event_type = Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }) node_id = 1 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a
6462024-11-19T01:45:04.821ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Unwinding saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
6472024-11-19T01:45:04.821ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = unwinding saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a
6482024-11-19T01:45:04.829ZDEBGnexus (SEC): saga log event new_state = N000 undo_started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
6492024-11-19T01:45:04.829ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 0 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a
6502024-11-19T01:45:04.834ZDEBGnexus (SEC): saga log event new_state = N000 undo_finished sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
6512024-11-19T01:45:04.834ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 0 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a
6522024-11-19T01:45:04.838ZDEBGnexus (SEC): saga log event new_state = N004 undo_started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
6532024-11-19T01:45:04.838ZDEBGnexus (SecStore): recording saga event event_type = UndoStarted node_id = 4 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a
6542024-11-19T01:45:04.841ZDEBGnexus (SEC): saga log event new_state = N004 undo_finished sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
6552024-11-19T01:45:04.841ZDEBGnexus (SecStore): recording saga event event_type = UndoFinished node_id = 4 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a
6562024-11-19T01:45:04.844ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
6572024-11-19T01:45:04.844ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a
6582024-11-19T01:45:04.850ZWARNnexus (SEC): saga finished action_error_node_name = "no_result1" action_error_source = ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} } file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1044 result = failure saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b undo_result = success
6592024-11-19T01:45:04.850ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 240f49e8-bd34-443a-b697-0678ea2a2b4a saga_name = instance-delete saga_result = SagaResult { saga_id: 240f49e8-bd34-443a-b697-0678ea2a2b4a, saga_log: SagaLog { saga_id: 240f49e8-bd34-443a-b697-0678ea2a2b4a, unwinding: true, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 failed, N000 undo_started, N000 undo_finished, N004 undo_started, N004 undo_finished], node_status: {0: UndoFinished, 1: Failed(ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }), 4: UndoFinished} }, kind: Err(SagaResultErr { error_node_name: "no_result1", error_source: ActionFailed { source_error: Object {"InvalidRequest": Object {"message": Object {"external_message": String("cannot delete instance: instance is running or has not yet fully stopped"), "internal_context": String("")}}} }, undo_failure: None }) }
6602024-11-19T01:45:04.850ZINFOnexus (dropshot_external): request completed error_message_external = cannot delete instance: instance is running or has not yet fully stopped error_message_internal = cannot delete instance: instance is running or has not yet fully stopped (with internal context: saga ACTION error at node "no_result1") file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 564937 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 61edff7e-9bfc-43d7-aec0-194da2737d3a response_code = 400 uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
6612024-11-19T01:45:05.578ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/f29067fd-e978-4a5d-8f3c-f6f062710092/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4b1ad8e-ed63-423b-9f63-addf6ba0e2fb", "content-length": "132", "date": "Tue, 19 Nov 2024 01:45:05 GMT"} })
6622024-11-19T01:45:05.581ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a sled_id = 302245ee-8785-4baf-86ed-0823410907ec state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-19T01:45:05.488982383Z }, migration_in: None, migration_out: None } vmm_id = f29067fd-e978-4a5d-8f3c-f6f062710092
6632024-11-19T01:45:05.581ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = f29067fd-e978-4a5d-8f3c-f6f062710092 sled_id = 302245ee-8785-4baf-86ed-0823410907ec vmm_id = f29067fd-e978-4a5d-8f3c-f6f062710092 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-19T01:45:05.488982383Z }
6642024-11-19T01:45:05.581ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a roles = RoleSet { roles: {} } sled_id = 302245ee-8785-4baf-86ed-0823410907ec vmm_id = f29067fd-e978-4a5d-8f3c-f6f062710092
6652024-11-19T01:45:05.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a resource = Database result = Ok(()) sled_id = 302245ee-8785-4baf-86ed-0823410907ec vmm_id = f29067fd-e978-4a5d-8f3c-f6f062710092
6662024-11-19T01:45:05.614ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
6672024-11-19T01:45:05.616ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 1.380377834s iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"destroyed":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
6682024-11-19T01:45:05.853ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6692024-11-19T01:45:05.853ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6702024-11-19T01:45:05.854ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6712024-11-19T01:45:05.854ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6722024-11-19T01:45:05.856ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6732024-11-19T01:45:05.857ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("token = \\"2cf93d2e93fb282cf3086910605871c6c790ce41\\"") } result = Ok(())
6742024-11-19T01:45:05.857ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6752024-11-19T01:45:05.857ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6762024-11-19T01:45:05.858ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6772024-11-19T01:45:05.858ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6782024-11-19T01:45:05.860ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6792024-11-19T01:45:05.860ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6802024-11-19T01:45:05.862ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6812024-11-19T01:45:05.862ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6822024-11-19T01:45:05.863ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6832024-11-19T01:45:05.864ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
6842024-11-19T01:45:05.864ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6852024-11-19T01:45:05.864ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6862024-11-19T01:45:05.865ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6872024-11-19T01:45:05.867ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("2cf93d2e93fb282cf3086910605871c6c790ce41") } result = Ok(())
6882024-11-19T01:45:05.867ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6892024-11-19T01:45:05.867ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6902024-11-19T01:45:05.871ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6912024-11-19T01:45:05.871ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6922024-11-19T01:45:05.872ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6932024-11-19T01:45:05.873ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6942024-11-19T01:45:05.874ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6952024-11-19T01:45:05.874ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6962024-11-19T01:45:05.875ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
6972024-11-19T01:45:05.875ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
6982024-11-19T01:45:05.876ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
6992024-11-19T01:45:05.877ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
7002024-11-19T01:45:05.878ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7012024-11-19T01:45:05.878ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7022024-11-19T01:45:05.879ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7032024-11-19T01:45:05.879ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7042024-11-19T01:45:05.881ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
7052024-11-19T01:45:05.881ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
7062024-11-19T01:45:05.882ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
7072024-11-19T01:45:05.883ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) } result = Ok(())
7082024-11-19T01:45:05.883ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7092024-11-19T01:45:05.883ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7102024-11-19T01:45:05.885ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7112024-11-19T01:45:05.885ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7122024-11-19T01:45:05.887ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7132024-11-19T01:45:05.887ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7142024-11-19T01:45:05.888ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7152024-11-19T01:45:05.888ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7162024-11-19T01:45:05.891ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7172024-11-19T01:45:05.891ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7182024-11-19T01:45:05.893ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7192024-11-19T01:45:05.893ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7202024-11-19T01:45:05.895ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 roles = RoleSet { roles: {} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7212024-11-19T01:45:05.895ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 resource = Database result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7222024-11-19T01:45:05.898ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7232024-11-19T01:45:05.900ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ByName("instance-ab8d5c5749") } result = Ok(()) uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
7242024-11-19T01:45:05.900ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
7252024-11-19T01:45:05.900ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
7262024-11-19T01:45:05.901ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
7272024-11-19T01:45:05.903ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
7282024-11-19T01:45:05.903ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
7292024-11-19T01:45:05.903ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
7302024-11-19T01:45:05.907ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete
7312024-11-19T01:45:05.907ZINFOnexus (SEC): saga create dag = {"end_node":5,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,0,null],[3,5,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"instance_delete.instance_delete_nat","label":"InstanceDeleteNat","name":"no_result4"}},{"Action":{"action_name":"instance_delete.instance_delete_record","label":"InstanceDeleteRecord","name":"no_result1"}},{"Action":{"action_name":"instance_delete.delete_network_interfaces","label":"DeleteNetworkInterfaces","name":"no_result2"}},{"Action":{"action_name":"instance_delete.deallocate_external_ip","label":"DeallocateExternalIp","name":"no_result3"}},{"Start":{"params":{"authz_instance":{"key":"9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a","lookup_type":{"ByName":"instance-ab8d5c5749"},"parent":{"key":"43ed357a-1904-4080-ab4e-07192398e688","lookup_type":{"ByName":"proj-b2f4478829e"},"parent":{"key":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa","lookup_type":{"ById":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa"},"parent":null}}},"boundary_switches":["switch0"],"instance":{"auto_restart":{"cooldown":null,"policy":null},"boot_disk_id":"86a86001-384a-4275-bd9e-a066e76750a7","hostname":"localshark","identity":{"description":"","id":"9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a","name":"instance-ab8d5c5749","time_created":"2024-11-19T01:44:42.710477Z","time_deleted":null,"time_modified":"2024-11-19T01:44:42.710477Z"},"memory":1073741824,"ncpus":2,"project_id":"43ed357a-1904-4080-ab4e-07192398e688","runtime_state":{"dst_propolis_id":null,"gen":3,"migration_id":null,"nexus_state":"Vmm","propolis_id":"f29067fd-e978-4a5d-8f3c-f6f062710092","time_last_auto_restarted":null,"time_updated":"2024-11-19T01:44:42.710477Z"},"updater_gen":3,"updater_id":"9b1e1baf-58de-4735-9f10-8e295a116d78","user_data":[]},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa","silo_user_id":"b2fcdebd-1828-4cea-80ef-2c95bec46fd5"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"instance-delete","start_node":4} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
7322024-11-19T01:45:05.907ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete
7332024-11-19T01:45:05.911ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete
7342024-11-19T01:45:05.911ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
7352024-11-19T01:45:05.911ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
7362024-11-19T01:45:05.911ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357
7372024-11-19T01:45:05.915ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
7382024-11-19T01:45:05.915ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357
7392024-11-19T01:45:05.918ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
7402024-11-19T01:45:05.918ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357
7412024-11-19T01:45:05.923ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7422024-11-19T01:45:05.923ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7432024-11-19T01:45:05.925ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7442024-11-19T01:45:05.925ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7452024-11-19T01:45:05.927ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7462024-11-19T01:45:05.927ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7472024-11-19T01:45:05.929ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7482024-11-19T01:45:05.929ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7492024-11-19T01:45:05.931ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7502024-11-19T01:45:05.931ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7512024-11-19T01:45:05.934ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7522024-11-19T01:45:05.934ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7532024-11-19T01:45:05.937ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7542024-11-19T01:45:05.937ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7552024-11-19T01:45:05.939ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7562024-11-19T01:45:05.942ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ById(43ed357a-1904-4080-ab4e-07192398e688) }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ById(9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a) } result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7572024-11-19T01:45:05.942ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a
7582024-11-19T01:45:05.942ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7592024-11-19T01:45:05.942ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7602024-11-19T01:45:05.944ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7612024-11-19T01:45:05.944ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7622024-11-19T01:45:05.946ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
7632024-11-19T01:45:05.946ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7642024-11-19T01:45:05.946ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteNat
7652024-11-19T01:45:05.948ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
7662024-11-19T01:45:05.948ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
7672024-11-19T01:45:05.948ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
7682024-11-19T01:45:05.950ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
7692024-11-19T01:45:05.951ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
7702024-11-19T01:45:05.951ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
7712024-11-19T01:45:05.951ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
7722024-11-19T01:45:05.960ZDEBGnexus: notifying dendrite of updates instance_id = Some(9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a (instance)) switch = switch0
7732024-11-19T01:45:05.960ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1756, tv_nsec: 128536293 } })
7742024-11-19T01:45:05.961ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1131
7752024-11-19T01:45:05.991ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
7762024-11-19T01:45:05.991ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7772024-11-19T01:45:05.991ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6750cea6-279d-490a-bb13-613be454d5db", "content-length": "26", "date": "Tue, 19 Nov 2024 01:45:05 GMT"} })
7782024-11-19T01:45:05.991ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7792024-11-19T01:45:05.992ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7802024-11-19T01:45:06.022ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
7812024-11-19T01:45:06.022ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "e341c294-e857-44cc-965a-3b14b6774a08", "content-length": "4", "date": "Tue, 19 Nov 2024 01:45:05 GMT"} })
7822024-11-19T01:45:06.024ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
7832024-11-19T01:45:06.024ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 0 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357
7842024-11-19T01:45:06.028ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
7852024-11-19T01:45:06.028ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357
7862024-11-19T01:45:06.031ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
7872024-11-19T01:45:06.032ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
7882024-11-19T01:45:06.034ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
7892024-11-19T01:45:06.034ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
7902024-11-19T01:45:06.037ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
7912024-11-19T01:45:06.037ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
7922024-11-19T01:45:06.040ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
7932024-11-19T01:45:06.040ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
7942024-11-19T01:45:06.042ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
7952024-11-19T01:45:06.044ZDEBGnexus (SagaExecutor): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ByName("instance-ab8d5c5749") } result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
7962024-11-19T01:45:06.044ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
7972024-11-19T01:45:06.044ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
7982024-11-19T01:45:06.123ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
7992024-11-19T01:45:06.123ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
8002024-11-19T01:45:06.129ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
8012024-11-19T01:45:06.129ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = InstanceDeleteRecord
8022024-11-19T01:45:06.131ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
8032024-11-19T01:45:06.131ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357
8042024-11-19T01:45:06.134ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
8052024-11-19T01:45:06.134ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357
8062024-11-19T01:45:06.138ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
8072024-11-19T01:45:06.138ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
8082024-11-19T01:45:06.140ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
8092024-11-19T01:45:06.141ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
8102024-11-19T01:45:06.143ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
8112024-11-19T01:45:06.143ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
8122024-11-19T01:45:06.145ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
8132024-11-19T01:45:06.145ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
8142024-11-19T01:45:06.148ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
8152024-11-19T01:45:06.150ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 9dbe2cf6-3afc-4bd1-9876-14136d7f2e8a, lookup_type: ByName("instance-ab8d5c5749") } result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
8162024-11-19T01:45:06.150ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
8172024-11-19T01:45:06.151ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeleteNetworkInterfaces
8182024-11-19T01:45:06.161ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
8192024-11-19T01:45:06.161ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357
8202024-11-19T01:45:06.161ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Signaled
8212024-11-19T01:45:06.161ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8222024-11-19T01:45:06.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8232024-11-19T01:45:06.164ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
8242024-11-19T01:45:06.164ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357
8252024-11-19T01:45:06.168ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeallocateExternalIp
8262024-11-19T01:45:06.168ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeallocateExternalIp
8272024-11-19T01:45:06.172ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8282024-11-19T01:45:06.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8292024-11-19T01:45:06.180ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8302024-11-19T01:45:06.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8312024-11-19T01:45:06.181ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8322024-11-19T01:45:06.183ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8332024-11-19T01:45:06.183ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8342024-11-19T01:45:06.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8352024-11-19T01:45:06.184ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8362024-11-19T01:45:06.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8372024-11-19T01:45:06.186ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8382024-11-19T01:45:06.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8392024-11-19T01:45:06.218ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8402024-11-19T01:45:06.218ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7513df78-9652-4211-b710-5c0ae575c858", "content-length": "691", "date": "Tue, 19 Nov 2024 01:45:05 GMT"} })
8412024-11-19T01:45:06.218ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
8422024-11-19T01:45:06.218ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
8432024-11-19T01:45:06.218ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
8442024-11-19T01:45:06.219ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 58.463635ms iteration = 28 status = {}
8452024-11-19T01:45:06.242ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeallocateExternalIp
8462024-11-19T01:45:06.242ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_node = DeallocateExternalIp
8472024-11-19T01:45:06.320ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
8482024-11-19T01:45:06.320ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357
8492024-11-19T01:45:06.325ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
8502024-11-19T01:45:06.325ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357
8512024-11-19T01:45:06.328ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
8522024-11-19T01:45:06.329ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357
8532024-11-19T01:45:06.332ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
8542024-11-19T01:45:06.332ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357
8552024-11-19T01:45:06.340ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
8562024-11-19T01:45:06.340ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 4658bb30-420f-4eaa-ae58-6491dff5e357 saga_name = instance-delete saga_result = SagaResult { saga_id: 4658bb30-420f-4eaa-ae58-6491dff5e357, saga_log: SagaLog { saga_id: 4658bb30-420f-4eaa-ae58-6491dff5e357, unwinding: false, events: [N004 started, N004 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N005 started, N005 succeeded], node_status: {0: Succeeded(Null), 1: Succeeded(Null), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"no_result1": Null, "no_result2": Null, "no_result3": Null, "no_result4": Null} }) }
8572024-11-19T01:45:06.340ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 487459 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 5a4d3b0c-d89a-4733-a5e6-1d9f92833aa2 response_code = 204 uri = /v1/instances/instance-ab8d5c5749?project=proj-b2f4478829e
8582024-11-19T01:45:06.340ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Signaled
8592024-11-19T01:45:06.340ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
8602024-11-19T01:45:06.340ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8612024-11-19T01:45:06.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8622024-11-19T01:45:06.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8632024-11-19T01:45:06.343ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8642024-11-19T01:45:06.343ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8652024-11-19T01:45:06.344ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8662024-11-19T01:45:06.344ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8672024-11-19T01:45:06.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8682024-11-19T01:45:06.345ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8692024-11-19T01:45:06.345ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8702024-11-19T01:45:06.345ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8712024-11-19T01:45:06.346ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8722024-11-19T01:45:06.347ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8732024-11-19T01:45:06.347ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8742024-11-19T01:45:06.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8752024-11-19T01:45:06.348ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("token = \\"2cf93d2e93fb282cf3086910605871c6c790ce41\\"") } result = Ok(())
8762024-11-19T01:45:06.348ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8772024-11-19T01:45:06.348ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8782024-11-19T01:45:06.349ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8792024-11-19T01:45:06.349ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8802024-11-19T01:45:06.350ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8812024-11-19T01:45:06.351ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8822024-11-19T01:45:06.352ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8832024-11-19T01:45:06.353ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8842024-11-19T01:45:06.354ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8852024-11-19T01:45:06.355ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
8862024-11-19T01:45:06.355ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8872024-11-19T01:45:06.355ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8882024-11-19T01:45:06.380ZINFOnexus (BackgroundTasks): VPC route manager sled 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
8892024-11-19T01:45:06.380ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8902024-11-19T01:45:06.381ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "602a7e28-4522-47d6-bc21-c2bb7ab0f668", "content-length": "372", "date": "Tue, 19 Nov 2024 01:45:05 GMT"} })
8912024-11-19T01:45:06.381ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8922024-11-19T01:45:06.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8932024-11-19T01:45:06.382ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
8942024-11-19T01:45:06.383ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("2cf93d2e93fb282cf3086910605871c6c790ce41") } result = Ok(())
8952024-11-19T01:45:06.383ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8962024-11-19T01:45:06.383ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8972024-11-19T01:45:06.388ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
8982024-11-19T01:45:06.389ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
8992024-11-19T01:45:06.390ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9002024-11-19T01:45:06.390ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9012024-11-19T01:45:06.392ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9022024-11-19T01:45:06.392ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9032024-11-19T01:45:06.393ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9042024-11-19T01:45:06.393ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9052024-11-19T01:45:06.394ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
9062024-11-19T01:45:06.394ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
9072024-11-19T01:45:06.394ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "53323987-1712-4840-b14e-8643adaaff65", "date": "Tue, 19 Nov 2024 01:45:05 GMT"} })
9082024-11-19T01:45:06.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9092024-11-19T01:45:06.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9102024-11-19T01:45:06.394ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
9112024-11-19T01:45:06.396ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
9122024-11-19T01:45:06.396ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9132024-11-19T01:45:06.396ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9142024-11-19T01:45:06.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9152024-11-19T01:45:06.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9162024-11-19T01:45:06.397ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9172024-11-19T01:45:06.398ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9182024-11-19T01:45:06.399ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
9192024-11-19T01:45:06.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9202024-11-19T01:45:06.399ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
9212024-11-19T01:45:06.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9222024-11-19T01:45:06.401ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
9232024-11-19T01:45:06.402ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) } result = Ok(())
9242024-11-19T01:45:06.402ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9252024-11-19T01:45:06.402ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Database result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9262024-11-19T01:45:06.402ZINFOnexus (BackgroundTasks): VPC route manager sled 302245ee-8785-4baf-86ed-0823410907ec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
9272024-11-19T01:45:06.402ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9282024-11-19T01:45:06.402ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "46ccaf44-125a-4483-9736-50d95a942e1d", "date": "Tue, 19 Nov 2024 01:45:05 GMT"} })
9292024-11-19T01:45:06.403ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9302024-11-19T01:45:06.403ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Database result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9312024-11-19T01:45:06.404ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 63.7322ms iteration = 28 status = {}
9322024-11-19T01:45:06.405ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9332024-11-19T01:45:06.405ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Database result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9342024-11-19T01:45:06.407ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9352024-11-19T01:45:06.407ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Database result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9362024-11-19T01:45:06.410ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9372024-11-19T01:45:06.410ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Database result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9382024-11-19T01:45:06.412ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9392024-11-19T01:45:06.412ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Database result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9402024-11-19T01:45:06.414ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9412024-11-19T01:45:06.414ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Database result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9422024-11-19T01:45:06.416ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9432024-11-19T01:45:06.419ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 86a86001-384a-4275-bd9e-a066e76750a7, lookup_type: ByName("disk-9569d826487") } result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9442024-11-19T01:45:06.419ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9452024-11-19T01:45:06.419ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Database result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9462024-11-19T01:45:06.421ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9472024-11-19T01:45:06.421ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Database result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9482024-11-19T01:45:06.422ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9492024-11-19T01:45:06.422ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Database result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9502024-11-19T01:45:06.423ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9512024-11-19T01:45:06.424ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Database result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9522024-11-19T01:45:06.426ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9532024-11-19T01:45:06.426ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Database result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9542024-11-19T01:45:06.428ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9552024-11-19T01:45:06.428ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Database result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9562024-11-19T01:45:06.430ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9572024-11-19T01:45:06.430ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Database result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9582024-11-19T01:45:06.432ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9592024-11-19T01:45:06.435ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ById(43ed357a-1904-4080-ab4e-07192398e688) }, key: 86a86001-384a-4275-bd9e-a066e76750a7, lookup_type: ById(86a86001-384a-4275-bd9e-a066e76750a7) } result = Ok(()) uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
9602024-11-19T01:45:06.435ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete
9612024-11-19T01:45:06.435ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[3,4,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa","silo_user_id":"b2fcdebd-1828-4cea-80ef-2c95bec46fd5"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"f95d695a-d74d-4bb5-af96-1931f570bbfd"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.find_freed_crucible_regions","label":"FindFreedCrucibleRegions","name":"freed_crucible_regions"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"volume_hard_deleted"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"86a86001-384a-4275-bd9e-a066e76750a7","project_id":"43ed357a-1904-4080-ab4e-07192398e688","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa","silo_user_id":"b2fcdebd-1828-4cea-80ef-2c95bec46fd5"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"f95d695a-d74d-4bb5-af96-1931f570bbfd"}}},"End"]},"saga_name":"disk-delete","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9622024-11-19T01:45:06.435ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete
9632024-11-19T01:45:06.444ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete
9642024-11-19T01:45:06.444ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9652024-11-19T01:45:06.444ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9662024-11-19T01:45:06.444ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9672024-11-19T01:45:06.450ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9682024-11-19T01:45:06.450ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9692024-11-19T01:45:06.455ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9702024-11-19T01:45:06.455ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9712024-11-19T01:45:06.473ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9722024-11-19T01:45:06.473ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": String("1fce9f7e-1f0d-4209-9d6b-0f6cea19c75f"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("86a86001-384a-4275-bd9e-a066e76750a7"), "name": String("disk-9569d826487"), "time_created": String("2024-11-19T01:44:41.359511Z"), "time_deleted": Null, "time_modified": String("2024-11-19T01:44:41.359511Z")}, "pantry_address": Null, "project_id": String("43ed357a-1904-4080-ab4e-07192398e688"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-19T01:44:42.522919Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("f95d695a-d74d-4bb5-af96-1931f570bbfd")}) node_id = 0 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9732024-11-19T01:45:06.477ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9742024-11-19T01:45:06.477ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9752024-11-19T01:45:06.481ZDEBGnexus (SagaExecutor): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true roles = RoleSet { roles: {} } saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete saga_node = SpaceAccount
9762024-11-19T01:45:06.481ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true resource = Database result = Ok(()) saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete saga_node = SpaceAccount
9772024-11-19T01:45:06.493ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9782024-11-19T01:45:06.493ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9792024-11-19T01:45:06.497ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9802024-11-19T01:45:06.497ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9812024-11-19T01:45:06.500ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9822024-11-19T01:45:06.500ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("7ae1255b-c149-4b2a-8f4e-7489cdeaaefa"), "silo_user_id": String("b2fcdebd-1828-4cea-80ef-2c95bec46fd5")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("f95d695a-d74d-4bb5-af96-1931f570bbfd")}) node_id = 2 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9832024-11-19T01:45:06.504ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9842024-11-19T01:45:06.504ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9852024-11-19T01:45:06.507ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9862024-11-19T01:45:06.507ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9872024-11-19T01:45:06.510ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9882024-11-19T01:45:06.510ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9892024-11-19T01:45:06.573ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9902024-11-19T01:45:06.573ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("8ff1d237-b41f-48d5-afa4-1bd3edf2e6f3"), String("971efcdc-fc47-460f-9ea4-1211be45fa59"), String("0e0bae50-dd37-45d6-814e-0c1882619817")]}}) node_id = 4 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9912024-11-19T01:45:06.577ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9922024-11-19T01:45:06.577ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9932024-11-19T01:45:06.580ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9942024-11-19T01:45:06.580ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9952024-11-19T01:45:06.585ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
9962024-11-19T01:45:06.585ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
9972024-11-19T01:45:06.619ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 91.337252ms file = nexus/src/app/crucible.rs:828 region_id = 971efcdc-fc47-460f-9ea4-1211be45fa59 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete
9982024-11-19T01:45:06.620ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 130.575169ms file = nexus/src/app/crucible.rs:828 region_id = 8ff1d237-b41f-48d5-afa4-1bd3edf2e6f3 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete
9992024-11-19T01:45:06.620ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 98.216979ms file = nexus/src/app/crucible.rs:828 region_id = 0e0bae50-dd37-45d6-814e-0c1882619817 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete
10002024-11-19T01:45:06.716ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 971efcdc-fc47-460f-9ea4-1211be45fa59 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete
10012024-11-19T01:45:06.724ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 0e0bae50-dd37-45d6-814e-0c1882619817 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete
10022024-11-19T01:45:06.755ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 8ff1d237-b41f-48d5-afa4-1bd3edf2e6f3 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete
10032024-11-19T01:45:06.802ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10042024-11-19T01:45:06.802ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10052024-11-19T01:45:06.807ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10062024-11-19T01:45:06.807ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10072024-11-19T01:45:06.811ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10082024-11-19T01:45:06.811ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10092024-11-19T01:45:06.815ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10102024-11-19T01:45:06.815ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10112024-11-19T01:45:06.818ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10122024-11-19T01:45:06.818ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10132024-11-19T01:45:06.822ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10142024-11-19T01:45:06.822ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10152024-11-19T01:45:06.836ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10162024-11-19T01:45:06.836ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 9 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10172024-11-19T01:45:06.839ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10182024-11-19T01:45:06.839ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10192024-11-19T01:45:06.844ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10202024-11-19T01:45:06.844ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10212024-11-19T01:45:06.848ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10222024-11-19T01:45:06.848ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10232024-11-19T01:45:06.854ZINFOnexus (SagaExecutor): allocated regions for f95d695a-d74d-4bb5-af96-1931f570bbfd is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:531 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete
10242024-11-19T01:45:06.859ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10252024-11-19T01:45:06.859ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10262024-11-19T01:45:06.862ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10272024-11-19T01:45:06.862ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10282024-11-19T01:45:06.866ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10292024-11-19T01:45:06.866ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10302024-11-19T01:45:06.869ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10312024-11-19T01:45:06.869ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10322024-11-19T01:45:06.872ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10332024-11-19T01:45:06.872ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10342024-11-19T01:45:06.876ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10352024-11-19T01:45:06.876ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c
10362024-11-19T01:45:06.883ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete sec_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
10372024-11-19T01:45:06.883ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c saga_name = disk-delete saga_result = SagaResult { saga_id: e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c, saga_log: SagaLog { saga_id: e3d12d47-3f68-4ae5-a0e5-6b5ef7578e9c, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N006 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": String("1fce9f7e-1f0d-4209-9d6b-0f6cea19c75f"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("86a86001-384a-4275-bd9e-a066e76750a7"), "name": String("disk-9569d826487"), "time_created": String("2024-11-19T01:44:41.359511Z"), "time_deleted": Null, "time_modified": String("2024-11-19T01:44:41.359511Z")}, "pantry_address": Null, "project_id": String("43ed357a-1904-4080-ab4e-07192398e688"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-19T01:44:42.522919Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("f95d695a-d74d-4bb5-af96-1931f570bbfd")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("7ae1255b-c149-4b2a-8f4e-7489cdeaaefa"), "silo_user_id": String("b2fcdebd-1828-4cea-80ef-2c95bec46fd5")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("f95d695a-d74d-4bb5-af96-1931f570bbfd")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("8ff1d237-b41f-48d5-afa4-1bd3edf2e6f3"), String("971efcdc-fc47-460f-9ea4-1211be45fa59"), String("0e0bae50-dd37-45d6-814e-0c1882619817")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Array []), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("8ff1d237-b41f-48d5-afa4-1bd3edf2e6f3"), String("971efcdc-fc47-460f-9ea4-1211be45fa59"), String("0e0bae50-dd37-45d6-814e-0c1882619817")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": String("1fce9f7e-1f0d-4209-9d6b-0f6cea19c75f"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("86a86001-384a-4275-bd9e-a066e76750a7"), "name": String("disk-9569d826487"), "time_created": String("2024-11-19T01:44:41.359511Z"), "time_deleted": Null, "time_modified": String("2024-11-19T01:44:41.359511Z")}, "pantry_address": Null, "project_id": String("43ed357a-1904-4080-ab4e-07192398e688"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-19T01:44:42.522919Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("f95d695a-d74d-4bb5-af96-1931f570bbfd")}, "freed_crucible_regions": Array [], "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("7ae1255b-c149-4b2a-8f4e-7489cdeaaefa"), "silo_user_id": String("b2fcdebd-1828-4cea-80ef-2c95bec46fd5")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("f95d695a-d74d-4bb5-af96-1931f570bbfd")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
10382024-11-19T01:45:06.883ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 541954 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 16d85489-ce78-4ea7-9c91-27bd4a8e5524 response_code = 204 uri = /v1/disks/disk-9569d826487?project=proj-b2f4478829e
10392024-11-19T01:45:06.888ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10402024-11-19T01:45:06.889ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10412024-11-19T01:45:06.890ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10422024-11-19T01:45:06.890ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10432024-11-19T01:45:06.891ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10442024-11-19T01:45:06.893ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("token = \\"2cf93d2e93fb282cf3086910605871c6c790ce41\\"") } result = Ok(())
10452024-11-19T01:45:06.893ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10462024-11-19T01:45:06.893ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10472024-11-19T01:45:06.894ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10482024-11-19T01:45:06.894ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10492024-11-19T01:45:06.896ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10502024-11-19T01:45:06.896ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10512024-11-19T01:45:06.897ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10522024-11-19T01:45:06.898ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10532024-11-19T01:45:06.899ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10542024-11-19T01:45:06.900ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
10552024-11-19T01:45:06.900ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10562024-11-19T01:45:06.900ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10572024-11-19T01:45:06.901ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10582024-11-19T01:45:06.903ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("2cf93d2e93fb282cf3086910605871c6c790ce41") } result = Ok(())
10592024-11-19T01:45:06.903ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10602024-11-19T01:45:06.903ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10612024-11-19T01:45:06.906ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10622024-11-19T01:45:06.907ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10632024-11-19T01:45:06.908ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10642024-11-19T01:45:06.908ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10652024-11-19T01:45:06.909ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10662024-11-19T01:45:06.909ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10672024-11-19T01:45:06.910ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10682024-11-19T01:45:06.911ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10692024-11-19T01:45:06.912ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10702024-11-19T01:45:06.913ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
10712024-11-19T01:45:06.913ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10722024-11-19T01:45:06.913ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10732024-11-19T01:45:06.914ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10742024-11-19T01:45:06.914ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10752024-11-19T01:45:06.916ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
10762024-11-19T01:45:06.916ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
10772024-11-19T01:45:06.917ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
10782024-11-19T01:45:06.918ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) } result = Ok(())
10792024-11-19T01:45:06.923ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10802024-11-19T01:45:06.923ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10812024-11-19T01:45:06.925ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10822024-11-19T01:45:06.925ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10832024-11-19T01:45:06.926ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10842024-11-19T01:45:06.926ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10852024-11-19T01:45:06.928ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10862024-11-19T01:45:06.929ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10872024-11-19T01:45:06.930ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10882024-11-19T01:45:06.930ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10892024-11-19T01:45:06.932ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10902024-11-19T01:45:06.932ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10912024-11-19T01:45:06.934ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10922024-11-19T01:45:06.934ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10932024-11-19T01:45:06.936ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10942024-11-19T01:45:06.937ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10952024-11-19T01:45:06.939ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10962024-11-19T01:45:06.942ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 8bd95c7a-14a4-4121-8c02-7e47b90c7785, lookup_type: ByName("default") }, key: 6fcb2d13-d4b8-4abe-b27b-de51d3525c6b, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10972024-11-19T01:45:06.942ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10982024-11-19T01:45:06.942ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
10992024-11-19T01:45:06.944ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11002024-11-19T01:45:06.945ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11012024-11-19T01:45:06.947ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11022024-11-19T01:45:06.947ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11032024-11-19T01:45:06.948ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11042024-11-19T01:45:06.949ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11052024-11-19T01:45:06.951ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11062024-11-19T01:45:06.954ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 8bd95c7a-14a4-4121-8c02-7e47b90c7785, lookup_type: ByName("default") }, key: 6fcb2d13-d4b8-4abe-b27b-de51d3525c6b, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11072024-11-19T01:45:06.954ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11082024-11-19T01:45:06.954ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11092024-11-19T01:45:06.956ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11102024-11-19T01:45:06.956ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11112024-11-19T01:45:06.962ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11122024-11-19T01:45:06.962ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11132024-11-19T01:45:06.999ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11142024-11-19T01:45:06.999ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11152024-11-19T01:45:07.017ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132685 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = c5266c50-bc08-4e21-ba21-629314ae16fd response_code = 204 uri = /v1/vpc-subnets/default?project=proj-b2f4478829e&vpc=default
11162024-11-19T01:45:07.017ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Signaled
11172024-11-19T01:45:07.017ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
11182024-11-19T01:45:07.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11192024-11-19T01:45:07.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11202024-11-19T01:45:07.018ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11212024-11-19T01:45:07.018ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11222024-11-19T01:45:07.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11232024-11-19T01:45:07.019ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11242024-11-19T01:45:07.020ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11252024-11-19T01:45:07.020ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11262024-11-19T01:45:07.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11272024-11-19T01:45:07.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11282024-11-19T01:45:07.021ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11292024-11-19T01:45:07.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11302024-11-19T01:45:07.023ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("token = \\"2cf93d2e93fb282cf3086910605871c6c790ce41\\"") } result = Ok(())
11312024-11-19T01:45:07.023ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11322024-11-19T01:45:07.023ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11332024-11-19T01:45:07.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11342024-11-19T01:45:07.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11352024-11-19T01:45:07.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11362024-11-19T01:45:07.024ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11372024-11-19T01:45:07.025ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11382024-11-19T01:45:07.026ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11392024-11-19T01:45:07.026ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11402024-11-19T01:45:07.028ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11412024-11-19T01:45:07.028ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11422024-11-19T01:45:07.029ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11432024-11-19T01:45:07.030ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
11442024-11-19T01:45:07.030ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11452024-11-19T01:45:07.030ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11462024-11-19T01:45:07.031ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11472024-11-19T01:45:07.032ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("2cf93d2e93fb282cf3086910605871c6c790ce41") } result = Ok(())
11482024-11-19T01:45:07.032ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11492024-11-19T01:45:07.032ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11502024-11-19T01:45:07.056ZINFOnexus (BackgroundTasks): VPC route manager sled 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
11512024-11-19T01:45:07.056ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11522024-11-19T01:45:07.056ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "884b7424-94f8-4612-a32e-eb44c33c2603", "content-length": "372", "date": "Tue, 19 Nov 2024 01:45:07 GMT"} })
11532024-11-19T01:45:07.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11542024-11-19T01:45:07.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11552024-11-19T01:45:07.068ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11562024-11-19T01:45:07.068ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11572024-11-19T01:45:07.069ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11582024-11-19T01:45:07.070ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11592024-11-19T01:45:07.070ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
11602024-11-19T01:45:07.070ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
11612024-11-19T01:45:07.070ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "76c04cc5-5a4e-4642-9611-8f3543d4a22a", "date": "Tue, 19 Nov 2024 01:45:07 GMT"} })
11622024-11-19T01:45:07.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11632024-11-19T01:45:07.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11642024-11-19T01:45:07.071ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11652024-11-19T01:45:07.071ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11662024-11-19T01:45:07.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11672024-11-19T01:45:07.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11682024-11-19T01:45:07.073ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11692024-11-19T01:45:07.073ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11702024-11-19T01:45:07.074ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11712024-11-19T01:45:07.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11722024-11-19T01:45:07.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11732024-11-19T01:45:07.076ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
11742024-11-19T01:45:07.076ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11752024-11-19T01:45:07.076ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11762024-11-19T01:45:07.077ZINFOnexus (BackgroundTasks): VPC route manager sled 302245ee-8785-4baf-86ed-0823410907ec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
11772024-11-19T01:45:07.077ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11782024-11-19T01:45:07.077ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
11792024-11-19T01:45:07.077ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11802024-11-19T01:45:07.078ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "843e8eee-0a6d-4145-add5-31cf35012952", "date": "Tue, 19 Nov 2024 01:45:07 GMT"} })
11812024-11-19T01:45:07.079ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
11822024-11-19T01:45:07.079ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
11832024-11-19T01:45:07.079ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 62.376315ms iteration = 29 status = {}
11842024-11-19T01:45:07.080ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
11852024-11-19T01:45:07.081ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) } result = Ok(())
11862024-11-19T01:45:07.081ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
11872024-11-19T01:45:07.082ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
11882024-11-19T01:45:07.083ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
11892024-11-19T01:45:07.083ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
11902024-11-19T01:45:07.085ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
11912024-11-19T01:45:07.085ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
11922024-11-19T01:45:07.087ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
11932024-11-19T01:45:07.087ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
11942024-11-19T01:45:07.090ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
11952024-11-19T01:45:07.090ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
11962024-11-19T01:45:07.092ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
11972024-11-19T01:45:07.093ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
11982024-11-19T01:45:07.095ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
11992024-11-19T01:45:07.095ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12002024-11-19T01:45:07.097ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12012024-11-19T01:45:07.100ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 8bd95c7a-14a4-4121-8c02-7e47b90c7785, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12022024-11-19T01:45:07.100ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12032024-11-19T01:45:07.100ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12042024-11-19T01:45:07.102ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12052024-11-19T01:45:07.102ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12062024-11-19T01:45:07.105ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12072024-11-19T01:45:07.105ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12082024-11-19T01:45:07.107ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12092024-11-19T01:45:07.107ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12102024-11-19T01:45:07.109ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12112024-11-19T01:45:07.112ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 8bd95c7a-14a4-4121-8c02-7e47b90c7785, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12122024-11-19T01:45:07.112ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12132024-11-19T01:45:07.112ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12142024-11-19T01:45:07.116ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12152024-11-19T01:45:07.116ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12162024-11-19T01:45:07.122ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12172024-11-19T01:45:07.122ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12182024-11-19T01:45:07.124ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12192024-11-19T01:45:07.124ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12202024-11-19T01:45:07.127ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12212024-11-19T01:45:07.127ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12222024-11-19T01:45:07.129ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12232024-11-19T01:45:07.129ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12242024-11-19T01:45:07.131ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12252024-11-19T01:45:07.134ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 8bd95c7a-14a4-4121-8c02-7e47b90c7785, lookup_type: ByName("default") }, key: 6c0ab546-fdde-4090-bac6-3a7677d61cb4, lookup_type: ById(6c0ab546-fdde-4090-bac6-3a7677d61cb4) } result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12262024-11-19T01:45:07.134ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12272024-11-19T01:45:07.135ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12282024-11-19T01:45:07.140ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12292024-11-19T01:45:07.140ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12302024-11-19T01:45:07.146ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12312024-11-19T01:45:07.147ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12322024-11-19T01:45:07.149ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12332024-11-19T01:45:07.149ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12342024-11-19T01:45:07.151ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12352024-11-19T01:45:07.152ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12362024-11-19T01:45:07.154ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12372024-11-19T01:45:07.154ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12382024-11-19T01:45:07.156ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12392024-11-19T01:45:07.156ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12402024-11-19T01:45:07.158ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12412024-11-19T01:45:07.161ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") }, key: 8bd95c7a-14a4-4121-8c02-7e47b90c7785, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12422024-11-19T01:45:07.161ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-b2f4478829e
12432024-11-19T01:45:07.161ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-b2f4478829e
12442024-11-19T01:45:07.168ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150190 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = f3f821dc-8039-4008-8354-db598e425092 response_code = 204 uri = /v1/vpcs/default?project=proj-b2f4478829e
12452024-11-19T01:45:07.173ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12462024-11-19T01:45:07.174ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12472024-11-19T01:45:07.175ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12482024-11-19T01:45:07.175ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12492024-11-19T01:45:07.177ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12502024-11-19T01:45:07.178ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("token = \\"2cf93d2e93fb282cf3086910605871c6c790ce41\\"") } result = Ok(())
12512024-11-19T01:45:07.178ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12522024-11-19T01:45:07.178ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12532024-11-19T01:45:07.180ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12542024-11-19T01:45:07.181ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12552024-11-19T01:45:07.183ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12562024-11-19T01:45:07.183ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12572024-11-19T01:45:07.185ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12582024-11-19T01:45:07.185ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12592024-11-19T01:45:07.187ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12602024-11-19T01:45:07.188ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
12612024-11-19T01:45:07.188ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12622024-11-19T01:45:07.188ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12632024-11-19T01:45:07.190ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12642024-11-19T01:45:07.191ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "2cf93d2e93fb282cf3086910605871c6c790ce41", lookup_type: ByCompositeId("2cf93d2e93fb282cf3086910605871c6c790ce41") } result = Ok(())
12652024-11-19T01:45:07.191ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12662024-11-19T01:45:07.191ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12672024-11-19T01:45:07.207ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12682024-11-19T01:45:07.207ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12692024-11-19T01:45:07.208ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12702024-11-19T01:45:07.209ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12712024-11-19T01:45:07.210ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12722024-11-19T01:45:07.210ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12732024-11-19T01:45:07.212ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12742024-11-19T01:45:07.212ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12752024-11-19T01:45:07.213ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12762024-11-19T01:45:07.214ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, lookup_type: ById(b2fcdebd-1828-4cea-80ef-2c95bec46fd5) } result = Ok(())
12772024-11-19T01:45:07.214ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12782024-11-19T01:45:07.215ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12792024-11-19T01:45:07.216ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12802024-11-19T01:45:07.216ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12812024-11-19T01:45:07.217ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
12822024-11-19T01:45:07.218ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
12832024-11-19T01:45:07.219ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
12842024-11-19T01:45:07.220ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) } result = Ok(())
12852024-11-19T01:45:07.220ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
12862024-11-19T01:45:07.220ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
12872024-11-19T01:45:07.222ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
12882024-11-19T01:45:07.222ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
12892024-11-19T01:45:07.223ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
12902024-11-19T01:45:07.224ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
12912024-11-19T01:45:07.225ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
12922024-11-19T01:45:07.225ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
12932024-11-19T01:45:07.228ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
12942024-11-19T01:45:07.228ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
12952024-11-19T01:45:07.230ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
12962024-11-19T01:45:07.230ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
12972024-11-19T01:45:07.233ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/projects/proj-b2f4478829e
12982024-11-19T01:45:07.235ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") } result = Ok(()) uri = /v1/projects/proj-b2f4478829e
12992024-11-19T01:45:07.235ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
13002024-11-19T01:45:07.235ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
13012024-11-19T01:45:07.237ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
13022024-11-19T01:45:07.237ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
13032024-11-19T01:45:07.239ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
13042024-11-19T01:45:07.239ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
13052024-11-19T01:45:07.241ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
13062024-11-19T01:45:07.241ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
13072024-11-19T01:45:07.243ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {(Silo, 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, "admin")} } uri = /v1/projects/proj-b2f4478829e
13082024-11-19T01:45:07.245ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Project { parent: Silo { parent: Fleet, key: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, lookup_type: ById(7ae1255b-c149-4b2a-8f4e-7489cdeaaefa) }, key: 43ed357a-1904-4080-ab4e-07192398e688, lookup_type: ByName("proj-b2f4478829e") } result = Ok(()) uri = /v1/projects/proj-b2f4478829e
13092024-11-19T01:45:07.245ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
13102024-11-19T01:45:07.245ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
13112024-11-19T01:45:07.248ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
13122024-11-19T01:45:07.248ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
13132024-11-19T01:45:07.250ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
13142024-11-19T01:45:07.250ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
13152024-11-19T01:45:07.263ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
13162024-11-19T01:45:07.263ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
13172024-11-19T01:45:07.271ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
13182024-11-19T01:45:07.271ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
13192024-11-19T01:45:07.279ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
13202024-11-19T01:45:07.280ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
13212024-11-19T01:45:07.281ZDEBGnexus (dropshot_external): roles actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee roles = RoleSet { roles: {} } uri = /v1/projects/proj-b2f4478829e
13222024-11-19T01:45:07.282ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: b2fcdebd-1828-4cea-80ef-2c95bec46fd5, silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, .. }) actor_id = b2fcdebd-1828-4cea-80ef-2c95bec46fd5 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee resource = Database result = Ok(()) uri = /v1/projects/proj-b2f4478829e
13232024-11-19T01:45:07.291ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122640 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.1.100:46800 req_id = 10b1ed71-adc0-4ac7-97df-07df8c5255ee response_code = 204 uri = /v1/projects/proj-b2f4478829e
13242024-11-19T01:45:11.810ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1694 local_addr = [fd00:1122:3344:101::a]:61083 method = GET remote_addr = [fd00:1122:3344:101::d]:34824 req_id = e61457af-cb8d-4120-a41b-25e73d0f4981 response_code = 200 uri = /7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
13252024-11-19T01:45:14.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
13262024-11-19T01:45:14.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13272024-11-19T01:45:14.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13282024-11-19T01:45:14.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
13292024-11-19T01:45:14.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13302024-11-19T01:45:14.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13312024-11-19T01:45:14.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13322024-11-19T01:45:14.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13332024-11-19T01:45:14.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13342024-11-19T01:45:14.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13352024-11-19T01:45:14.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13362024-11-19T01:45:14.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.101793ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13372024-11-19T01:45:14.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13382024-11-19T01:45:14.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13392024-11-19T01:45:14.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13402024-11-19T01:45:14.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13412024-11-19T01:45:14.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 42cc80b5-1c54-4919-b680-9adaa2eee120, lookup_type: ById(42cc80b5-1c54-4919-b680-9adaa2eee120) } result = Ok(())
13422024-11-19T01:45:14.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13432024-11-19T01:45:14.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13442024-11-19T01:45:14.257ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 original_time_created = 2024-11-19 01:32:24.851324 UTC target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 time_created = 2024-11-19 01:32:24.851324 UTC
13452024-11-19T01:45:14.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.3474ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"42cc80b5-1c54-4919-b680-9adaa2eee120","time_created":"2024-11-19T01:32:24.851324Z"}
13462024-11-19T01:45:16.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39306 req_id = 9d3a8ddb-943c-4e9f-9355-8a2baad3671b roles = RoleSet { roles: {} } uri = /metrics/collectors/b8403c47-1584-4cc7-8521-f7e7869f6be7/producers?sort_by=id_ascending
13472024-11-19T01:45:16.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39306 req_id = 9d3a8ddb-943c-4e9f-9355-8a2baad3671b resource = Database result = Ok(()) uri = /metrics/collectors/b8403c47-1584-4cc7-8521-f7e7869f6be7/producers?sort_by=id_ascending
13482024-11-19T01:45:16.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3857 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39306 req_id = 9d3a8ddb-943c-4e9f-9355-8a2baad3671b response_code = 200 uri = /metrics/collectors/b8403c47-1584-4cc7-8521-f7e7869f6be7/producers?sort_by=id_ascending
13492024-11-19T01:45:16.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39306 req_id = bf697fd1-fc94-4ffc-9515-5d8b2d920a09 roles = RoleSet { roles: {} } uri = /metrics/collectors/b8403c47-1584-4cc7-8521-f7e7869f6be7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzkxZWQ4OS0xMzM1LTRlODAtOTA0NS04ZjFjNTA2NTQ4OWYifX0%3D
13502024-11-19T01:45:16.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39306 req_id = bf697fd1-fc94-4ffc-9515-5d8b2d920a09 resource = Database result = Ok(()) uri = /metrics/collectors/b8403c47-1584-4cc7-8521-f7e7869f6be7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzkxZWQ4OS0xMzM1LTRlODAtOTA0NS04ZjFjNTA2NTQ4OWYifX0%3D
13512024-11-19T01:45:16.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39306 req_id = bf697fd1-fc94-4ffc-9515-5d8b2d920a09 response_code = 200 uri = /metrics/collectors/b8403c47-1584-4cc7-8521-f7e7869f6be7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlNzkxZWQ4OS0xMzM1LTRlODAtOTA0NS04ZjFjNTA2NTQ4OWYifX0%3D
13522024-11-19T01:45:24.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
13532024-11-19T01:45:24.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13542024-11-19T01:45:24.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13552024-11-19T01:45:24.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
13562024-11-19T01:45:24.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13572024-11-19T01:45:24.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13582024-11-19T01:45:24.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13592024-11-19T01:45:24.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13602024-11-19T01:45:24.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13612024-11-19T01:45:24.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.083873ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13622024-11-19T01:45:24.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13632024-11-19T01:45:24.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13642024-11-19T01:45:24.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13652024-11-19T01:45:24.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13662024-11-19T01:45:24.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13672024-11-19T01:45:24.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13682024-11-19T01:45:24.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 42cc80b5-1c54-4919-b680-9adaa2eee120, lookup_type: ById(42cc80b5-1c54-4919-b680-9adaa2eee120) } result = Ok(())
13692024-11-19T01:45:24.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13702024-11-19T01:45:24.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13712024-11-19T01:45:24.257ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 original_time_created = 2024-11-19 01:32:24.851324 UTC target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 time_created = 2024-11-19 01:32:24.851324 UTC
13722024-11-19T01:45:24.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.216147ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"42cc80b5-1c54-4919-b680-9adaa2eee120","time_created":"2024-11-19T01:32:24.851324Z"}
13732024-11-19T01:45:26.811ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::a]:61083 method = GET remote_addr = [fd00:1122:3344:101::d]:34824 req_id = e9320d58-3f8e-4073-ad48-dbc3f678ac3a response_code = 200 uri = /7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
13742024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
13752024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
13762024-11-19T01:45:34.235ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120
13772024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
13782024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.43\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"42cc80b5-1c54-4919-b680-9adaa2eee120"}
13792024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
13802024-11-19T01:45:34.235ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
13812024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13822024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
13832024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
13842024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
13852024-11-19T01:45:34.235ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-19 01:35:34.235256206 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
13862024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
13872024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13882024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
13892024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
13902024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
13912024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
13922024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
13932024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13942024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13952024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
13962024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
13972024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13982024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13992024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
14002024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
14012024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
14022024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14032024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
14042024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
14052024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14062024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14072024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
14082024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
14092024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14102024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14112024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
14122024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14132024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14142024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14152024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14162024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14172024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14182024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14192024-11-19T01:45:34.235ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("52e4d19a-b928-4138-8817-4fd8deeaf29e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a97a9e1e-ade8-4d48-bc64-1b5a63e68b91.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a97a9e1e-ade8-4d48-bc64-1b5a63e68b91.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1784, tv_nsec: 403034588 } })
14202024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14212024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14222024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14232024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
14242024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
14252024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
14262024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14272024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
14282024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14292024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
14302024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14312024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14322024-11-19T01:45:34.235ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
14332024-11-19T01:45:34.235ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1e98d393-d940-4def-ba7c-d8c67ea23aa1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efd7fee1-3fb4-451f-a329-22d734d942b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efd7fee1-3fb4-451f-a329-22d734d942b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1784, tv_nsec: 403105269 } })
14342024-11-19T01:45:34.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14352024-11-19T01:45:34.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14362024-11-19T01:45:34.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
14372024-11-19T01:45:34.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14382024-11-19T01:45:34.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14392024-11-19T01:45:34.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14402024-11-19T01:45:34.236ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
14412024-11-19T01:45:34.236ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.054009ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
14422024-11-19T01:45:34.236ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
14432024-11-19T01:45:34.236ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.08779ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
14442024-11-19T01:45:34.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14452024-11-19T01:45:34.237ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
14462024-11-19T01:45:34.238ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14472024-11-19T01:45:34.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14482024-11-19T01:45:34.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14492024-11-19T01:45:34.239ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
14502024-11-19T01:45:34.239ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
14512024-11-19T01:45:34.239ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-19 01:35:34.235256206 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
14522024-11-19T01:45:34.239ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.931091ms iteration = 14 status = {"expiration":"2024-11-19T01:35:34.235256206Z","pruned":[]}
14532024-11-19T01:45:34.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
14542024-11-19T01:45:34.239ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.030372ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14552024-11-19T01:45:34.239ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1784, tv_nsec: 406873257 } })
14562024-11-19T01:45:34.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14572024-11-19T01:45:34.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
14582024-11-19T01:45:34.239ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
14592024-11-19T01:45:34.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14602024-11-19T01:45:34.239ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14612024-11-19T01:45:34.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
14622024-11-19T01:45:34.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14632024-11-19T01:45:34.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
14642024-11-19T01:45:34.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14652024-11-19T01:45:34.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
14662024-11-19T01:45:34.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14672024-11-19T01:45:34.240ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
14682024-11-19T01:45:34.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14692024-11-19T01:45:34.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
14702024-11-19T01:45:34.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14712024-11-19T01:45:34.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14722024-11-19T01:45:34.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14732024-11-19T01:45:34.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14742024-11-19T01:45:34.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14752024-11-19T01:45:34.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14762024-11-19T01:45:34.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14772024-11-19T01:45:34.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14782024-11-19T01:45:34.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14792024-11-19T01:45:34.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14802024-11-19T01:45:34.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
14812024-11-19T01:45:34.242ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14822024-11-19T01:45:34.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
14832024-11-19T01:45:34.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
14842024-11-19T01:45:34.242ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14852024-11-19T01:45:34.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14862024-11-19T01:45:34.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14872024-11-19T01:45:34.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14882024-11-19T01:45:34.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
14892024-11-19T01:45:34.244ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14902024-11-19T01:45:34.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
14912024-11-19T01:45:34.244ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1784, tv_nsec: 411943328 } })
14922024-11-19T01:45:34.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14932024-11-19T01:45:34.245ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
14942024-11-19T01:45:34.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14952024-11-19T01:45:34.246ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14962024-11-19T01:45:34.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14972024-11-19T01:45:34.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14982024-11-19T01:45:34.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14992024-11-19T01:45:34.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15002024-11-19T01:45:34.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15012024-11-19T01:45:34.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15022024-11-19T01:45:34.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15032024-11-19T01:45:34.248ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15042024-11-19T01:45:34.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15052024-11-19T01:45:34.249ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15062024-11-19T01:45:34.249ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15072024-11-19T01:45:34.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15082024-11-19T01:45:34.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15092024-11-19T01:45:34.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15102024-11-19T01:45:34.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15112024-11-19T01:45:34.251ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.15601ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
15122024-11-19T01:45:34.251ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.213291ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
15132024-11-19T01:45:34.252ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
15142024-11-19T01:45:34.252ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
15152024-11-19T01:45:34.252ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 13.046953ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
15162024-11-19T01:45:34.252ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15172024-11-19T01:45:34.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15182024-11-19T01:45:34.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15192024-11-19T01:45:34.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15202024-11-19T01:45:34.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15212024-11-19T01:45:34.255ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15222024-11-19T01:45:34.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15232024-11-19T01:45:34.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15242024-11-19T01:45:34.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15252024-11-19T01:45:34.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15262024-11-19T01:45:34.258ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15272024-11-19T01:45:34.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15282024-11-19T01:45:34.259ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1784, tv_nsec: 426743062 } })
15292024-11-19T01:45:34.259ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49
15302024-11-19T01:45:34.261ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15312024-11-19T01:45:34.261ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15322024-11-19T01:45:34.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15332024-11-19T01:45:34.261ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15342024-11-19T01:45:34.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15352024-11-19T01:45:34.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
15362024-11-19T01:45:34.264ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15372024-11-19T01:45:34.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15382024-11-19T01:45:34.283ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15392024-11-19T01:45:34.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15402024-11-19T01:45:34.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15412024-11-19T01:45:34.292ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15422024-11-19T01:45:34.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15432024-11-19T01:45:34.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15442024-11-19T01:45:34.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15452024-11-19T01:45:34.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15462024-11-19T01:45:34.298ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15472024-11-19T01:45:34.298ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15482024-11-19T01:45:34.299ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15492024-11-19T01:45:34.299ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.229851ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15502024-11-19T01:45:34.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15512024-11-19T01:45:34.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15522024-11-19T01:45:34.300ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15532024-11-19T01:45:34.300ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15542024-11-19T01:45:34.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15552024-11-19T01:45:34.301ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15562024-11-19T01:45:34.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15572024-11-19T01:45:34.302ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
15582024-11-19T01:45:34.302ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
15592024-11-19T01:45:34.302ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
15602024-11-19T01:45:34.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15612024-11-19T01:45:34.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15622024-11-19T01:45:34.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.255319ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
15632024-11-19T01:45:34.304ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15642024-11-19T01:45:34.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15652024-11-19T01:45:34.305ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
15662024-11-19T01:45:34.305ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
15672024-11-19T01:45:34.305ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 69.769458ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
15682024-11-19T01:45:34.305ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.121086ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15692024-11-19T01:45:34.305ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15702024-11-19T01:45:34.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15712024-11-19T01:45:34.306ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
15722024-11-19T01:45:34.306ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
15732024-11-19T01:45:34.306ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
15742024-11-19T01:45:34.306ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15752024-11-19T01:45:34.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15762024-11-19T01:45:34.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 302245ee-8785-4baf-86ed-0823410907ec, lookup_type: ById(302245ee-8785-4baf-86ed-0823410907ec) } result = Ok(())
15772024-11-19T01:45:34.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15782024-11-19T01:45:34.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15792024-11-19T01:45:34.308ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
15802024-11-19T01:45:34.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15812024-11-19T01:45:34.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15822024-11-19T01:45:34.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15832024-11-19T01:45:34.310ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 75.014601ms iteration = 27 status = 0
15842024-11-19T01:45:34.310ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15852024-11-19T01:45:34.310ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.35241ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
15862024-11-19T01:45:34.310ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 42cc80b5-1c54-4919-b680-9adaa2eee120, lookup_type: ById(42cc80b5-1c54-4919-b680-9adaa2eee120) } result = Ok(())
15872024-11-19T01:45:34.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15882024-11-19T01:45:34.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15892024-11-19T01:45:34.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15902024-11-19T01:45:34.316ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
15912024-11-19T01:45:34.316ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 5d343227-c6b7-4b08-bad4-2eb0742341f4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
15922024-11-19T01:45:34.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15932024-11-19T01:45:34.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15942024-11-19T01:45:34.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
15952024-11-19T01:45:34.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15962024-11-19T01:45:34.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15972024-11-19T01:45:34.319ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15982024-11-19T01:45:34.319ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15992024-11-19T01:45:34.319ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 83.231008ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16002024-11-19T01:45:34.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16012024-11-19T01:45:34.324ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16022024-11-19T01:45:34.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16032024-11-19T01:45:34.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16042024-11-19T01:45:34.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16052024-11-19T01:45:34.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16062024-11-19T01:45:34.328ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 5d343227-c6b7-4b08-bad4-2eb0742341f4 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
16072024-11-19T01:45:34.329ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
16082024-11-19T01:45:34.329ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-19 01:32:33.664524 UTC dns_group = internal generation = 1
16092024-11-19T01:45:34.329ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 93.620374ms iteration = 14 status = {"generation":1}
16102024-11-19T01:45:34.329ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 original_time_created = 2024-11-19 01:32:24.851324 UTC target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 time_created = 2024-11-19 01:32:24.851324 UTC
16112024-11-19T01:45:34.329ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.850468ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"42cc80b5-1c54-4919-b680-9adaa2eee120","time_created":"2024-11-19T01:32:24.851324Z"}
16122024-11-19T01:45:34.339ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16132024-11-19T01:45:34.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16142024-11-19T01:45:34.342ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16152024-11-19T01:45:34.343ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16162024-11-19T01:45:34.343ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16172024-11-19T01:45:34.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16182024-11-19T01:45:34.346ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 111.128428ms iteration = 29 status = {"physical_disks_added":0}
16192024-11-19T01:45:34.348ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 108.269776ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16202024-11-19T01:45:34.355ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16212024-11-19T01:45:34.355ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 11d9bf96-5d56-48be-8c8a-411f4aeae63f dns_zone_name = oxide.test found_so_far = 0 version = 2
16222024-11-19T01:45:34.355ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16232024-11-19T01:45:34.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16242024-11-19T01:45:34.356ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16252024-11-19T01:45:34.357ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16262024-11-19T01:45:34.357ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16272024-11-19T01:45:34.357ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16282024-11-19T01:45:34.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16292024-11-19T01:45:34.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16302024-11-19T01:45:34.360ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16312024-11-19T01:45:34.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16322024-11-19T01:45:34.361ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
16332024-11-19T01:45:34.361ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 125.25316ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
16342024-11-19T01:45:34.362ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 11d9bf96-5d56-48be-8c8a-411f4aeae63f dns_zone_name = oxide.test found_so_far = 1 version = 2
16352024-11-19T01:45:34.362ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
16362024-11-19T01:45:34.362ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-19 01:32:36.054328 UTC dns_group = external generation = 2
16372024-11-19T01:45:34.362ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 126.867448ms iteration = 14 status = {"generation":2}
16382024-11-19T01:45:34.367ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16392024-11-19T01:45:34.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16402024-11-19T01:45:34.369ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 129.444395ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16412024-11-19T01:45:34.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16422024-11-19T01:45:34.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16432024-11-19T01:45:34.389ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
16442024-11-19T01:45:34.401ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-19T01:32:28.835276Z, time_modified: 2024-11-19T01:32:28.835276Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, db_silo: Silo { identity: SiloIdentity { id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T01:32:35.963389Z, time_modified: 2024-11-19T01:32:35.963389Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "230b491903daebcaf87cf435ebe6f0a0535f8ff306b818acc1839c538f57b468" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, db_silo: Silo { identity: SiloIdentity { id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T01:32:35.963389Z, time_modified: 2024-11-19T01:32:35.963389Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "230b491903daebcaf87cf435ebe6f0a0535f8ff306b818acc1839c538f57b468" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
16452024-11-19T01:45:34.401ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 166.565899ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa","tls_certs":["230b491903daebcaf87cf435ebe6f0a0535f8ff306b818acc1839c538f57b468"]}},"default_endpoint":{"silo_id":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa","tls_certs":["230b491903daebcaf87cf435ebe6f0a0535f8ff306b818acc1839c538f57b468"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
16462024-11-19T01:45:34.412ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
16472024-11-19T01:45:34.412ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16482024-11-19T01:45:34.412ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed8dad36-21d9-4b27-b6b2-229616a01dd0", "content-length": "26", "date": "Tue, 19 Nov 2024 01:45:33 GMT"} })
16492024-11-19T01:45:34.412ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16502024-11-19T01:45:34.414ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16512024-11-19T01:45:34.431ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 zone_address = fd00:1122:3344:101::2
16522024-11-19T01:45:34.431ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16532024-11-19T01:45:34.431ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ac40339-b720-4e46-bde8-b3f572d65852", "content-length": "26", "date": "Tue, 19 Nov 2024 01:45:33 GMT"} })
16542024-11-19T01:45:34.431ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16552024-11-19T01:45:34.433ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49
16562024-11-19T01:45:34.548ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16572024-11-19T01:45:34.551ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
16582024-11-19T01:45:34.551ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7add455f-adcb-4d6b-8bc8-426ff5b3dbec", "date": "Tue, 19 Nov 2024 01:45:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16592024-11-19T01:45:34.551ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16602024-11-19T01:45:34.553ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b136fb53-836b-4bce-a20e-b684591af352", "date": "Tue, 19 Nov 2024 01:45:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16612024-11-19T01:45:34.553ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16622024-11-19T01:45:34.555ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16632024-11-19T01:45:34.555ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 319.903081ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16642024-11-19T01:45:34.581ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
16652024-11-19T01:45:34.581ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16662024-11-19T01:45:34.581ZINFOnexus (BackgroundTasks): VPC route manager sled 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
16672024-11-19T01:45:34.581ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16682024-11-19T01:45:34.581ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b207c5ac-2ec4-47f4-905e-0b6ea2fe094f", "content-length": "26", "date": "Tue, 19 Nov 2024 01:45:34 GMT"} })
16692024-11-19T01:45:34.581ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16702024-11-19T01:45:34.581ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4f78850-2fff-4093-8f19-eee7679476a5", "content-length": "372", "date": "Tue, 19 Nov 2024 01:45:34 GMT"} })
16712024-11-19T01:45:34.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16722024-11-19T01:45:34.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16732024-11-19T01:45:34.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16742024-11-19T01:45:34.583ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16752024-11-19T01:45:34.584ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16762024-11-19T01:45:34.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16772024-11-19T01:45:34.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16782024-11-19T01:45:34.586ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16792024-11-19T01:45:34.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16802024-11-19T01:45:34.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16812024-11-19T01:45:34.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16822024-11-19T01:45:34.596ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16832024-11-19T01:45:34.596ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16842024-11-19T01:45:34.596ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "88f5318c-7d35-40ec-9d1c-b207846d9b42", "date": "Tue, 19 Nov 2024 01:45:34 GMT"} })
16852024-11-19T01:45:34.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16862024-11-19T01:45:34.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16872024-11-19T01:45:34.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16882024-11-19T01:45:34.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16892024-11-19T01:45:34.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16902024-11-19T01:45:34.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16912024-11-19T01:45:34.603ZINFOnexus (BackgroundTasks): VPC route manager sled 302245ee-8785-4baf-86ed-0823410907ec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16922024-11-19T01:45:34.603ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16932024-11-19T01:45:34.603ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f9db54ac-7128-408d-a8a1-03389eef2234", "date": "Tue, 19 Nov 2024 01:45:34 GMT"} })
16942024-11-19T01:45:34.605ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 367.127846ms iteration = 30 status = {}
16952024-11-19T01:45:34.719ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16962024-11-19T01:45:34.720ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "69b2c015-d074-4ed8-8075-f8ec1321e079", "content-length": "2", "date": "Tue, 19 Nov 2024 01:45:34 GMT"} })
16972024-11-19T01:45:34.722ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16982024-11-19T01:45:34.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16992024-11-19T01:45:34.725ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 489.784868ms iteration = 27 status = null
17002024-11-19T01:45:34.744ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17012024-11-19T01:45:34.744ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 509.132413ms iteration = 27 status = {}
17022024-11-19T01:45:34.744ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d240e270-43a6-4fd9-9188-6a2abf726d0e", "content-length": "691", "date": "Tue, 19 Nov 2024 01:45:34 GMT"} })
17032024-11-19T01:45:34.744ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
17042024-11-19T01:45:34.744ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
17052024-11-19T01:45:34.744ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
17062024-11-19T01:45:34.747ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 511.808941ms iteration = 29 status = {}
17072024-11-19T01:45:34.762ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
17082024-11-19T01:45:34.822ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
17092024-11-19T01:45:34.822ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9f2f877e-e689-41ff-893d-1360472f5c26", "date": "Tue, 19 Nov 2024 01:45:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17102024-11-19T01:45:34.822ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17112024-11-19T01:45:34.823ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9279400a-6a78-446a-bbef-25a429bdaf81", "date": "Tue, 19 Nov 2024 01:45:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17122024-11-19T01:45:34.823ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17132024-11-19T01:45:34.825ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f51a24d3-f8eb-4e81-9b02-eaaf80d61c1a", "date": "Tue, 19 Nov 2024 01:45:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17142024-11-19T01:45:34.825ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17152024-11-19T01:45:34.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17162024-11-19T01:45:34.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17172024-11-19T01:45:34.827ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
17182024-11-19T01:45:34.827ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 592.669608ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
17192024-11-19T01:45:34.829ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2ed5d87d-b512-430b-8a9f-5bee05700135, rack_id: cbab7bfb-8e8e-44f1-a93b-b95de3b50f49, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a8b5b6ed-8c4b-4b6d-a2dc-17e991abb0cd) } rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch_location = Switch0
17202024-11-19T01:45:34.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17212024-11-19T01:45:34.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17222024-11-19T01:45:34.840ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
17232024-11-19T01:45:34.840ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "af85fb45-7cf0-435c-8653-fec53e3a7409", "content-length": "134", "date": "Tue, 19 Nov 2024 01:45:34 GMT"} })
17242024-11-19T01:45:34.840ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
17252024-11-19T01:45:34.840ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a8b5b6ed-8c4b-4b6d-a2dc-17e991abb0cd
17262024-11-19T01:45:34.840ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
17272024-11-19T01:45:34.840ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
17282024-11-19T01:45:34.840ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17292024-11-19T01:45:34.840ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17302024-11-19T01:45:34.840ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17312024-11-19T01:45:34.840ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17322024-11-19T01:45:34.840ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
17332024-11-19T01:45:34.840ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
17342024-11-19T01:45:34.841ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49
17352024-11-19T01:45:34.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17362024-11-19T01:45:34.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17372024-11-19T01:45:34.843ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
17382024-11-19T01:45:34.843ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d31f8ee-33a9-4461-9c67-e5efdf2a1862", "content-length": "2", "date": "Tue, 19 Nov 2024 01:45:34 GMT"} })
17392024-11-19T01:45:34.843ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
17402024-11-19T01:45:34.843ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "314aa526-2518-4dee-9da0-2e50cd520b95", "content-length": "51", "date": "Tue, 19 Nov 2024 01:45:34 GMT"} })
17412024-11-19T01:45:34.843ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch_location = Switch0
17422024-11-19T01:45:34.843ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
17432024-11-19T01:45:34.944ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d7cf3b07-7026-490b-82dc-3cfd228f720b", "date": "Tue, 19 Nov 2024 01:45:34 GMT"} })
17442024-11-19T01:45:34.944ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch = Switch0
17452024-11-19T01:45:34.944ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
17462024-11-19T01:45:34.945ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9691f2b-966c-4031-8fcf-5ac2f3ae8086", "content-length": "682", "date": "Tue, 19 Nov 2024 01:45:34 GMT"} })
17472024-11-19T01:45:34.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17482024-11-19T01:45:34.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17492024-11-19T01:45:34.948ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17502024-11-19T01:45:34.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17512024-11-19T01:45:34.951ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17522024-11-19T01:45:34.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17532024-11-19T01:45:34.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17542024-11-19T01:45:34.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17552024-11-19T01:45:34.959ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 724.406633ms iteration = 27 status = {}
17562024-11-19T01:45:41.811ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::a]:61083 method = GET remote_addr = [fd00:1122:3344:101::d]:34824 req_id = ce956391-58c0-40fa-9cd8-5f0e0241e045 response_code = 200 uri = /7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
17572024-11-19T01:45:44.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
17582024-11-19T01:45:44.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17592024-11-19T01:45:44.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17602024-11-19T01:45:44.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
17612024-11-19T01:45:44.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17622024-11-19T01:45:44.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17632024-11-19T01:45:44.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17642024-11-19T01:45:44.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17652024-11-19T01:45:44.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17662024-11-19T01:45:44.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17672024-11-19T01:45:44.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17682024-11-19T01:45:44.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.309267ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17692024-11-19T01:45:44.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17702024-11-19T01:45:44.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17712024-11-19T01:45:44.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17722024-11-19T01:45:44.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17732024-11-19T01:45:44.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 42cc80b5-1c54-4919-b680-9adaa2eee120, lookup_type: ById(42cc80b5-1c54-4919-b680-9adaa2eee120) } result = Ok(())
17742024-11-19T01:45:44.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17752024-11-19T01:45:44.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17762024-11-19T01:45:44.259ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 original_time_created = 2024-11-19 01:32:24.851324 UTC target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 time_created = 2024-11-19 01:32:24.851324 UTC
17772024-11-19T01:45:44.259ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.344116ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"42cc80b5-1c54-4919-b680-9adaa2eee120","time_created":"2024-11-19T01:32:24.851324Z"}
17782024-11-19T01:45:54.236ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
17792024-11-19T01:45:54.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17802024-11-19T01:45:54.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17812024-11-19T01:45:54.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
17822024-11-19T01:45:54.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17832024-11-19T01:45:54.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17842024-11-19T01:45:54.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17852024-11-19T01:45:54.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17862024-11-19T01:45:54.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17872024-11-19T01:45:54.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.974241ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17882024-11-19T01:45:54.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17892024-11-19T01:45:54.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17902024-11-19T01:45:54.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17912024-11-19T01:45:54.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17922024-11-19T01:45:54.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17932024-11-19T01:45:54.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17942024-11-19T01:45:54.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 42cc80b5-1c54-4919-b680-9adaa2eee120, lookup_type: ById(42cc80b5-1c54-4919-b680-9adaa2eee120) } result = Ok(())
17952024-11-19T01:45:54.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17962024-11-19T01:45:54.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17972024-11-19T01:45:54.256ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 original_time_created = 2024-11-19 01:32:24.851324 UTC target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 time_created = 2024-11-19 01:32:24.851324 UTC
17982024-11-19T01:45:54.256ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.973247ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"42cc80b5-1c54-4919-b680-9adaa2eee120","time_created":"2024-11-19T01:32:24.851324Z"}
17992024-11-19T01:45:56.810ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::a]:61083 method = GET remote_addr = [fd00:1122:3344:101::d]:34824 req_id = a712fdba-eec9-4ee5-9120-6497ba3f8fe3 response_code = 200 uri = /7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
18002024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
18012024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
18022024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18032024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
18042024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18052024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
18062024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18072024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18082024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
18092024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
18102024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18112024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18122024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
18132024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
18142024-11-19T01:46:04.235ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18152024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18162024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18172024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18182024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18192024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18202024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18212024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18222024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
18232024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
18242024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18252024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18262024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
18272024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18282024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
18292024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18302024-11-19T01:46:04.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18312024-11-19T01:46:04.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18322024-11-19T01:46:04.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18332024-11-19T01:46:04.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18342024-11-19T01:46:04.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18352024-11-19T01:46:04.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18362024-11-19T01:46:04.238ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
18372024-11-19T01:46:04.238ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18382024-11-19T01:46:04.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18392024-11-19T01:46:04.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18402024-11-19T01:46:04.239ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.488583ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18412024-11-19T01:46:04.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18422024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18432024-11-19T01:46:04.240ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1814, tv_nsec: 407031636 } })
18442024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
18452024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
18462024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18472024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18482024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
18492024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18502024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
18512024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18522024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18532024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18542024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18552024-11-19T01:46:04.240ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
18562024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18572024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18582024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18592024-11-19T01:46:04.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18602024-11-19T01:46:04.241ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1814, tv_nsec: 407950672 } })
18612024-11-19T01:46:04.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
18622024-11-19T01:46:04.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18632024-11-19T01:46:04.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18642024-11-19T01:46:04.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18652024-11-19T01:46:04.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18662024-11-19T01:46:04.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18672024-11-19T01:46:04.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18682024-11-19T01:46:04.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18692024-11-19T01:46:04.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18702024-11-19T01:46:04.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18712024-11-19T01:46:04.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18722024-11-19T01:46:04.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18732024-11-19T01:46:04.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18742024-11-19T01:46:04.244ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18752024-11-19T01:46:04.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18762024-11-19T01:46:04.245ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18772024-11-19T01:46:04.245ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18782024-11-19T01:46:04.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18792024-11-19T01:46:04.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18802024-11-19T01:46:04.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18812024-11-19T01:46:04.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18822024-11-19T01:46:04.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18832024-11-19T01:46:04.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.070689ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
18842024-11-19T01:46:04.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18852024-11-19T01:46:04.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18862024-11-19T01:46:04.247ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18872024-11-19T01:46:04.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18882024-11-19T01:46:04.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18892024-11-19T01:46:04.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18902024-11-19T01:46:04.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18912024-11-19T01:46:04.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18922024-11-19T01:46:04.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18932024-11-19T01:46:04.250ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1814, tv_nsec: 417506073 } })
18942024-11-19T01:46:04.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18952024-11-19T01:46:04.251ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49
18962024-11-19T01:46:04.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18972024-11-19T01:46:04.251ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18982024-11-19T01:46:04.251ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18992024-11-19T01:46:04.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19002024-11-19T01:46:04.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19012024-11-19T01:46:04.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19022024-11-19T01:46:04.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19032024-11-19T01:46:04.254ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19042024-11-19T01:46:04.254ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 17.299009ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19052024-11-19T01:46:04.254ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19062024-11-19T01:46:04.254ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19072024-11-19T01:46:04.254ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 17.421601ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19082024-11-19T01:46:04.255ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19092024-11-19T01:46:04.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19102024-11-19T01:46:04.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19112024-11-19T01:46:04.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 42cc80b5-1c54-4919-b680-9adaa2eee120, lookup_type: ById(42cc80b5-1c54-4919-b680-9adaa2eee120) } result = Ok(())
19122024-11-19T01:46:04.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19132024-11-19T01:46:04.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19142024-11-19T01:46:04.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19152024-11-19T01:46:04.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19162024-11-19T01:46:04.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19172024-11-19T01:46:04.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19182024-11-19T01:46:04.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19192024-11-19T01:46:04.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19202024-11-19T01:46:04.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19212024-11-19T01:46:04.265ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 original_time_created = 2024-11-19 01:32:24.851324 UTC target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 time_created = 2024-11-19 01:32:24.851324 UTC
19222024-11-19T01:46:04.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.68ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"42cc80b5-1c54-4919-b680-9adaa2eee120","time_created":"2024-11-19T01:32:24.851324Z"}
19232024-11-19T01:46:04.266ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19242024-11-19T01:46:04.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19252024-11-19T01:46:04.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19262024-11-19T01:46:04.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19272024-11-19T01:46:04.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19282024-11-19T01:46:04.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19292024-11-19T01:46:04.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19302024-11-19T01:46:04.275ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19312024-11-19T01:46:04.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19322024-11-19T01:46:04.275ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19332024-11-19T01:46:04.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19342024-11-19T01:46:04.276ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19352024-11-19T01:46:04.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19362024-11-19T01:46:04.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 38.677341ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
19372024-11-19T01:46:04.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.509177ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
19382024-11-19T01:46:04.280ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19392024-11-19T01:46:04.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19402024-11-19T01:46:04.281ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19412024-11-19T01:46:04.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19422024-11-19T01:46:04.406ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
19432024-11-19T01:46:04.406ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "83d660b4-3e94-4913-b40a-85e9c5689d84", "content-length": "691", "date": "Tue, 19 Nov 2024 01:46:03 GMT"} })
19442024-11-19T01:46:04.406ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
19452024-11-19T01:46:04.406ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
19462024-11-19T01:46:04.406ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
19472024-11-19T01:46:04.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 170.775934ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19482024-11-19T01:46:04.407ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19492024-11-19T01:46:04.408ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19502024-11-19T01:46:04.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19512024-11-19T01:46:04.408ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 172.924702ms iteration = 30 status = {}
19522024-11-19T01:46:04.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 302245ee-8785-4baf-86ed-0823410907ec, lookup_type: ById(302245ee-8785-4baf-86ed-0823410907ec) } result = Ok(())
19532024-11-19T01:46:04.410ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19542024-11-19T01:46:04.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19552024-11-19T01:46:04.458ZINFOnexus (BackgroundTasks): VPC route manager sled 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19562024-11-19T01:46:04.458ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19572024-11-19T01:46:04.458ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "87cad197-ead0-46d2-8b10-e7e3c97bc9a5", "content-length": "372", "date": "Tue, 19 Nov 2024 01:46:03 GMT"} })
19582024-11-19T01:46:04.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19592024-11-19T01:46:04.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19602024-11-19T01:46:04.460ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 223.363145ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19612024-11-19T01:46:04.460ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 220.34566ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
19622024-11-19T01:46:04.461ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 225.419541ms iteration = 28 status = 0
19632024-11-19T01:46:04.474ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
19642024-11-19T01:46:04.474ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19652024-11-19T01:46:04.474ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0706c84f-4722-4cf9-874e-bd46bf7de10a", "date": "Tue, 19 Nov 2024 01:46:03 GMT"} })
19662024-11-19T01:46:04.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19672024-11-19T01:46:04.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19682024-11-19T01:46:04.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19692024-11-19T01:46:04.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19702024-11-19T01:46:04.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19712024-11-19T01:46:04.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19722024-11-19T01:46:04.483ZINFOnexus (BackgroundTasks): VPC route manager sled 302245ee-8785-4baf-86ed-0823410907ec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
19732024-11-19T01:46:04.483ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19742024-11-19T01:46:04.483ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "70f52692-4447-47c1-815f-8e18525ea8da", "date": "Tue, 19 Nov 2024 01:46:03 GMT"} })
19752024-11-19T01:46:04.485ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 246.413446ms iteration = 31 status = {}
19762024-11-19T01:46:04.495ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 259.180875ms iteration = 30 status = {"physical_disks_added":0}
19772024-11-19T01:46:04.547ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
19782024-11-19T01:46:04.547ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19792024-11-19T01:46:04.547ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0b4158b-d059-4599-af77-1f20e328ed38", "content-length": "26", "date": "Tue, 19 Nov 2024 01:46:04 GMT"} })
19802024-11-19T01:46:04.547ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19812024-11-19T01:46:04.549ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19822024-11-19T01:46:04.551ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
19832024-11-19T01:46:04.551ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19842024-11-19T01:46:04.551ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "20df18ce-4dea-4b5e-afe0-f117230285d7", "content-length": "26", "date": "Tue, 19 Nov 2024 01:46:04 GMT"} })
19852024-11-19T01:46:04.551ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19862024-11-19T01:46:04.553ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19872024-11-19T01:46:04.559ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 zone_address = fd00:1122:3344:101::2
19882024-11-19T01:46:04.559ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19892024-11-19T01:46:04.559ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7d82fbb-542c-4dc6-9a2d-fac8445cebc0", "content-length": "26", "date": "Tue, 19 Nov 2024 01:46:04 GMT"} })
19902024-11-19T01:46:04.559ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19912024-11-19T01:46:04.561ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49
19922024-11-19T01:46:04.627ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19932024-11-19T01:46:04.627ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc549be8-64d1-4a00-b836-697e524998ff", "content-length": "2", "date": "Tue, 19 Nov 2024 01:46:03 GMT"} })
19942024-11-19T01:46:04.629ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19952024-11-19T01:46:04.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19962024-11-19T01:46:04.630ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 395.070265ms iteration = 28 status = {}
19972024-11-19T01:46:04.631ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 395.665846ms iteration = 28 status = null
19982024-11-19T01:46:04.692ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19992024-11-19T01:46:04.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20002024-11-19T01:46:04.694ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2ed5d87d-b512-430b-8a9f-5bee05700135, rack_id: cbab7bfb-8e8e-44f1-a93b-b95de3b50f49, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a8b5b6ed-8c4b-4b6d-a2dc-17e991abb0cd) } rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch_location = Switch0
20012024-11-19T01:46:04.694ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20022024-11-19T01:46:04.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20032024-11-19T01:46:04.702ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20042024-11-19T01:46:04.702ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a5069fa-55ac-4654-a260-024298c115fe", "content-length": "134", "date": "Tue, 19 Nov 2024 01:46:03 GMT"} })
20052024-11-19T01:46:04.702ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20062024-11-19T01:46:04.702ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a8b5b6ed-8c4b-4b6d-a2dc-17e991abb0cd
20072024-11-19T01:46:04.702ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20082024-11-19T01:46:04.702ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20092024-11-19T01:46:04.702ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20102024-11-19T01:46:04.702ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20112024-11-19T01:46:04.702ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20122024-11-19T01:46:04.702ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20132024-11-19T01:46:04.703ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20142024-11-19T01:46:04.703ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20152024-11-19T01:46:04.703ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49
20162024-11-19T01:46:04.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20172024-11-19T01:46:04.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20182024-11-19T01:46:04.705ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20192024-11-19T01:46:04.705ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a85ae03-6152-4a7c-acfb-c78a221a2be6", "content-length": "2", "date": "Tue, 19 Nov 2024 01:46:03 GMT"} })
20202024-11-19T01:46:04.705ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20212024-11-19T01:46:04.705ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7542901-585a-4bf6-b6d7-9189b08c9ce2", "content-length": "51", "date": "Tue, 19 Nov 2024 01:46:03 GMT"} })
20222024-11-19T01:46:04.705ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch_location = Switch0
20232024-11-19T01:46:04.705ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20242024-11-19T01:46:04.809ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e712a2c6-145a-4a6f-88ca-77e10b46be07", "date": "Tue, 19 Nov 2024 01:46:04 GMT"} })
20252024-11-19T01:46:04.810ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch = Switch0
20262024-11-19T01:46:04.810ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20272024-11-19T01:46:04.810ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "da76dd78-7dc9-4f15-bb9a-439ffff44ef7", "content-length": "682", "date": "Tue, 19 Nov 2024 01:46:04 GMT"} })
20282024-11-19T01:46:04.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20292024-11-19T01:46:04.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20302024-11-19T01:46:04.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20312024-11-19T01:46:04.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20322024-11-19T01:46:04.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20332024-11-19T01:46:04.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20342024-11-19T01:46:04.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20352024-11-19T01:46:04.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20362024-11-19T01:46:04.825ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 589.702056ms iteration = 28 status = {}
20372024-11-19T01:46:05.056ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
20382024-11-19T01:46:05.056ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
20392024-11-19T01:46:05.087ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
20402024-11-19T01:46:05.087ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:45161
20412024-11-19T01:46:05.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:45161 req_id = c9c02673-3a59-42c6-bcad-dbe79af82f1e roles = RoleSet { roles: {} } uri = /metrics/producers
20422024-11-19T01:46:05.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:45161 req_id = c9c02673-3a59-42c6-bcad-dbe79af82f1e resource = Database result = Ok(()) uri = /metrics/producers
20432024-11-19T01:46:05.121ZINFOnexus: assigned collector to new producer collector_id = b8403c47-1584-4cc7-8521-f7e7869f6be7 file = nexus/src/app/oximeter.rs:76 producer_id = 7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
20442024-11-19T01:46:05.121ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34098 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:45161 req_id = c9c02673-3a59-42c6-bcad-dbe79af82f1e response_code = 201 uri = /metrics/producers
20452024-11-19T01:46:05.121ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "c9c02673-3a59-42c6-bcad-dbe79af82f1e", "content-length": "41", "date": "Tue, 19 Nov 2024 01:46:05 GMT"} })
20462024-11-19T01:46:05.124ZDEBGnexus (producer-registration-task): registered with nexus successfully
20472024-11-19T01:46:05.124ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
20482024-11-19T01:46:11.810ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::a]:61083 method = GET remote_addr = [fd00:1122:3344:101::d]:34824 req_id = 18d29602-f0a3-40c6-88a1-f75083475144 response_code = 200 uri = /7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
20492024-11-19T01:46:14.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
20502024-11-19T01:46:14.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20512024-11-19T01:46:14.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20522024-11-19T01:46:14.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
20532024-11-19T01:46:14.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20542024-11-19T01:46:14.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20552024-11-19T01:46:14.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20562024-11-19T01:46:14.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20572024-11-19T01:46:14.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20582024-11-19T01:46:14.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20592024-11-19T01:46:14.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20602024-11-19T01:46:14.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20612024-11-19T01:46:14.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.070202ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20622024-11-19T01:46:14.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20632024-11-19T01:46:14.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20642024-11-19T01:46:14.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20652024-11-19T01:46:14.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 42cc80b5-1c54-4919-b680-9adaa2eee120, lookup_type: ById(42cc80b5-1c54-4919-b680-9adaa2eee120) } result = Ok(())
20662024-11-19T01:46:14.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20672024-11-19T01:46:14.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20682024-11-19T01:46:14.258ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 original_time_created = 2024-11-19 01:32:24.851324 UTC target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 time_created = 2024-11-19 01:32:24.851324 UTC
20692024-11-19T01:46:14.258ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.663355ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"42cc80b5-1c54-4919-b680-9adaa2eee120","time_created":"2024-11-19T01:32:24.851324Z"}
20702024-11-19T01:46:24.236ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
20712024-11-19T01:46:24.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20722024-11-19T01:46:24.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20732024-11-19T01:46:24.237ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
20742024-11-19T01:46:24.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20752024-11-19T01:46:24.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20762024-11-19T01:46:24.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20772024-11-19T01:46:24.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20782024-11-19T01:46:24.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20792024-11-19T01:46:24.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20802024-11-19T01:46:24.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20812024-11-19T01:46:24.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20822024-11-19T01:46:24.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.125604ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20832024-11-19T01:46:24.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20842024-11-19T01:46:24.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20852024-11-19T01:46:24.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20862024-11-19T01:46:24.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 42cc80b5-1c54-4919-b680-9adaa2eee120, lookup_type: ById(42cc80b5-1c54-4919-b680-9adaa2eee120) } result = Ok(())
20872024-11-19T01:46:24.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20882024-11-19T01:46:24.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20892024-11-19T01:46:24.256ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 original_time_created = 2024-11-19 01:32:24.851324 UTC target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 time_created = 2024-11-19 01:32:24.851324 UTC
20902024-11-19T01:46:24.256ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.14878ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"42cc80b5-1c54-4919-b680-9adaa2eee120","time_created":"2024-11-19T01:32:24.851324Z"}
20912024-11-19T01:46:26.812ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::a]:61083 method = GET remote_addr = [fd00:1122:3344:101::d]:34824 req_id = 3f80e725-8e81-46d4-8b2e-7bb762af050a response_code = 200 uri = /7dcf0d8a-40d8-45f8-a6f1-d545f08c056b
20922024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
20932024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
20942024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
20952024-11-19T01:46:34.236ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-19 01:36:34.236575038 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
20962024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20972024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
20982024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
20992024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21002024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
21012024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
21022024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21032024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
21042024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
21052024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
21062024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
21072024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21082024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
21092024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21102024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
21112024-11-19T01:46:34.236ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120
21122024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
21132024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
21142024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.83\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"42cc80b5-1c54-4919-b680-9adaa2eee120"}
21152024-11-19T01:46:34.236ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
21162024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21172024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
21182024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
21192024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
21202024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
21212024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
21222024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21232024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
21242024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21252024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
21262024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21272024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
21282024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21292024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
21302024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21312024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
21322024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
21332024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
21342024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
21352024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
21362024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
21372024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
21382024-11-19T01:46:34.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
21392024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
21402024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21412024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21422024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21432024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21442024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
21452024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21462024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21472024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21482024-11-19T01:46:34.237ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("52e4d19a-b928-4138-8817-4fd8deeaf29e.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("a97a9e1e-ade8-4d48-bc64-1b5a63e68b91.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("a97a9e1e-ade8-4d48-bc64-1b5a63e68b91.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1844, tv_nsec: 403660783 } })
21492024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21502024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21512024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
21522024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
21532024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21542024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21552024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
21562024-11-19T01:46:34.237ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1e98d393-d940-4def-ba7c-d8c67ea23aa1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e48e23d9-6a0a-4bc6-9e0b-f83ba78952f1.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("efd7fee1-3fb4-451f-a329-22d734d942b3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("efd7fee1-3fb4-451f-a329-22d734d942b3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1844, tv_nsec: 403748004 } })
21572024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
21582024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
21592024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.018508ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
21602024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
21612024-11-19T01:46:34.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.177151ms iteration = 15 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
21622024-11-19T01:46:34.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21632024-11-19T01:46:34.238ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
21642024-11-19T01:46:34.238ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
21652024-11-19T01:46:34.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21662024-11-19T01:46:34.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21672024-11-19T01:46:34.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21682024-11-19T01:46:34.239ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
21692024-11-19T01:46:34.239ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
21702024-11-19T01:46:34.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
21712024-11-19T01:46:34.240ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-19 01:36:34.236575038 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
21722024-11-19T01:46:34.240ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.481232ms iteration = 15 status = {"expiration":"2024-11-19T01:36:34.236575038Z","pruned":[]}
21732024-11-19T01:46:34.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
21742024-11-19T01:46:34.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
21752024-11-19T01:46:34.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
21762024-11-19T01:46:34.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21772024-11-19T01:46:34.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
21782024-11-19T01:46:34.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
21792024-11-19T01:46:34.240ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
21802024-11-19T01:46:34.240ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
21812024-11-19T01:46:34.240ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
21822024-11-19T01:46:34.240ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
21832024-11-19T01:46:34.240ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1844, tv_nsec: 407190946 } })
21842024-11-19T01:46:34.240ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.255896ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
21852024-11-19T01:46:34.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21862024-11-19T01:46:34.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
21872024-11-19T01:46:34.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
21882024-11-19T01:46:34.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
21892024-11-19T01:46:34.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
21902024-11-19T01:46:34.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1131
21912024-11-19T01:46:34.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21922024-11-19T01:46:34.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21932024-11-19T01:46:34.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21942024-11-19T01:46:34.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1844, tv_nsec: 408901606 } })
21952024-11-19T01:46:34.242ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21962024-11-19T01:46:34.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1131
21972024-11-19T01:46:34.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21982024-11-19T01:46:34.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21992024-11-19T01:46:34.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22002024-11-19T01:46:34.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22012024-11-19T01:46:34.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22022024-11-19T01:46:34.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22032024-11-19T01:46:34.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22042024-11-19T01:46:34.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22052024-11-19T01:46:34.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22062024-11-19T01:46:34.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22072024-11-19T01:46:34.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22082024-11-19T01:46:34.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22092024-11-19T01:46:34.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22102024-11-19T01:46:34.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22112024-11-19T01:46:34.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22122024-11-19T01:46:34.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22132024-11-19T01:46:34.247ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22142024-11-19T01:46:34.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22152024-11-19T01:46:34.248ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22162024-11-19T01:46:34.248ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
22172024-11-19T01:46:34.248ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22182024-11-19T01:46:34.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
22192024-11-19T01:46:34.248ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22202024-11-19T01:46:34.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22212024-11-19T01:46:34.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22222024-11-19T01:46:34.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22232024-11-19T01:46:34.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22242024-11-19T01:46:34.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
22252024-11-19T01:46:34.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22262024-11-19T01:46:34.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22272024-11-19T01:46:34.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22282024-11-19T01:46:34.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22292024-11-19T01:46:34.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
22302024-11-19T01:46:34.253ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22312024-11-19T01:46:34.253ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22322024-11-19T01:46:34.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22332024-11-19T01:46:34.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22342024-11-19T01:46:34.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22352024-11-19T01:46:34.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22362024-11-19T01:46:34.255ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.747913ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
22372024-11-19T01:46:34.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22382024-11-19T01:46:34.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22392024-11-19T01:46:34.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22402024-11-19T01:46:34.258ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
22412024-11-19T01:46:34.258ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
22422024-11-19T01:46:34.258ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.913638ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
22432024-11-19T01:46:34.259ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
22442024-11-19T01:46:34.259ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
22452024-11-19T01:46:34.259ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
22462024-11-19T01:46:34.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22472024-11-19T01:46:34.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22482024-11-19T01:46:34.259ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 19.043941ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
22492024-11-19T01:46:34.260ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22502024-11-19T01:46:34.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22512024-11-19T01:46:34.261ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22522024-11-19T01:46:34.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22532024-11-19T01:46:34.262ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22542024-11-19T01:46:34.262ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-302245ee-8785-4baf-86ed-0823410907ec.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1844, tv_nsec: 429021416 } })
22552024-11-19T01:46:34.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22562024-11-19T01:46:34.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22572024-11-19T01:46:34.263ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1131 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49
22582024-11-19T01:46:34.263ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22592024-11-19T01:46:34.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22602024-11-19T01:46:34.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22612024-11-19T01:46:34.266ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
22622024-11-19T01:46:34.266ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
22632024-11-19T01:46:34.266ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
22642024-11-19T01:46:34.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22652024-11-19T01:46:34.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22662024-11-19T01:46:34.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22672024-11-19T01:46:34.267ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
22682024-11-19T01:46:34.267ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
22692024-11-19T01:46:34.267ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22702024-11-19T01:46:34.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22712024-11-19T01:46:34.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22722024-11-19T01:46:34.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22732024-11-19T01:46:34.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22742024-11-19T01:46:34.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
22752024-11-19T01:46:34.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22762024-11-19T01:46:34.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22772024-11-19T01:46:34.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
22782024-11-19T01:46:34.271ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22792024-11-19T01:46:34.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22802024-11-19T01:46:34.293ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.705713ms iteration = 29 status = {"errors":[],"records_set_to_done":[]}
22812024-11-19T01:46:34.306ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22822024-11-19T01:46:34.306ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.087993ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22832024-11-19T01:46:34.307ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22842024-11-19T01:46:34.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22852024-11-19T01:46:34.309ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
22862024-11-19T01:46:34.309ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22872024-11-19T01:46:34.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.002344ms iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
22882024-11-19T01:46:34.309ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 72.985395ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
22892024-11-19T01:46:34.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22902024-11-19T01:46:34.311ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22912024-11-19T01:46:34.311ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22922024-11-19T01:46:34.311ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22932024-11-19T01:46:34.311ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
22942024-11-19T01:46:34.311ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
22952024-11-19T01:46:34.311ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 75.152794ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
22962024-11-19T01:46:34.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22972024-11-19T01:46:34.313ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22982024-11-19T01:46:34.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22992024-11-19T01:46:34.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23002024-11-19T01:46:34.314ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23012024-11-19T01:46:34.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23022024-11-19T01:46:34.314ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23032024-11-19T01:46:34.314ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23042024-11-19T01:46:34.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23052024-11-19T01:46:34.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23062024-11-19T01:46:34.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23072024-11-19T01:46:34.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 302245ee-8785-4baf-86ed-0823410907ec, lookup_type: ById(302245ee-8785-4baf-86ed-0823410907ec) } result = Ok(())
23082024-11-19T01:46:34.318ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23092024-11-19T01:46:34.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23102024-11-19T01:46:34.318ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 42cc80b5-1c54-4919-b680-9adaa2eee120, lookup_type: ById(42cc80b5-1c54-4919-b680-9adaa2eee120) } result = Ok(())
23112024-11-19T01:46:34.318ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23122024-11-19T01:46:34.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23132024-11-19T01:46:34.319ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
23142024-11-19T01:46:34.319ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 11d9bf96-5d56-48be-8c8a-411f4aeae63f dns_zone_name = oxide.test found_so_far = 0 version = 2
23152024-11-19T01:46:34.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23162024-11-19T01:46:34.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23172024-11-19T01:46:34.319ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23182024-11-19T01:46:34.319ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.975744ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23192024-11-19T01:46:34.320ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.577804ms iteration = 29 status = 0
23202024-11-19T01:46:34.320ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23212024-11-19T01:46:34.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23222024-11-19T01:46:34.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23232024-11-19T01:46:34.322ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23242024-11-19T01:46:34.322ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
23252024-11-19T01:46:34.322ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 85.207463ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
23262024-11-19T01:46:34.323ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 82.232801ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
23272024-11-19T01:46:34.324ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23282024-11-19T01:46:34.324ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23292024-11-19T01:46:34.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23302024-11-19T01:46:34.326ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 11d9bf96-5d56-48be-8c8a-411f4aeae63f dns_zone_name = oxide.test found_so_far = 1 version = 2
23312024-11-19T01:46:34.326ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
23322024-11-19T01:46:34.326ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-19 01:32:36.054328 UTC dns_group = external generation = 2
23332024-11-19T01:46:34.326ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 89.716535ms iteration = 15 status = {"generation":2}
23342024-11-19T01:46:34.329ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23352024-11-19T01:46:34.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
23362024-11-19T01:46:34.331ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 original_time_created = 2024-11-19 01:32:24.851324 UTC target_id = 42cc80b5-1c54-4919-b680-9adaa2eee120 time_created = 2024-11-19 01:32:24.851324 UTC
23372024-11-19T01:46:34.331ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.669643ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"42cc80b5-1c54-4919-b680-9adaa2eee120","time_created":"2024-11-19T01:32:24.851324Z"}
23382024-11-19T01:46:34.343ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
23392024-11-19T01:46:34.343ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 5d343227-c6b7-4b08-bad4-2eb0742341f4 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
23402024-11-19T01:46:34.343ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23412024-11-19T01:46:34.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23422024-11-19T01:46:34.345ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23432024-11-19T01:46:34.347ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23442024-11-19T01:46:34.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23452024-11-19T01:46:34.348ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23462024-11-19T01:46:34.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23472024-11-19T01:46:34.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23482024-11-19T01:46:34.349ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23492024-11-19T01:46:34.351ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 5d343227-c6b7-4b08-bad4-2eb0742341f4 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
23502024-11-19T01:46:34.351ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
23512024-11-19T01:46:34.351ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-19 01:32:33.664524 UTC dns_group = internal generation = 1
23522024-11-19T01:46:34.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 114.334245ms iteration = 15 status = {"generation":1}
23532024-11-19T01:46:34.351ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23542024-11-19T01:46:34.351ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23552024-11-19T01:46:34.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23562024-11-19T01:46:34.361ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
23572024-11-19T01:46:34.361ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
23582024-11-19T01:46:34.377ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23592024-11-19T01:46:34.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23602024-11-19T01:46:34.379ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23612024-11-19T01:46:34.381ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23622024-11-19T01:46:34.381ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23632024-11-19T01:46:34.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23642024-11-19T01:46:34.393ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
23652024-11-19T01:46:34.393ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23662024-11-19T01:46:34.393ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "71e55b8e-8673-439d-b18f-3573fee7f93c", "content-length": "26", "date": "Tue, 19 Nov 2024 01:46:33 GMT"} })
23672024-11-19T01:46:34.393ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23682024-11-19T01:46:34.395ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23692024-11-19T01:46:34.395ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-19T01:32:28.835276Z, time_modified: 2024-11-19T01:32:28.835276Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, db_silo: Silo { identity: SiloIdentity { id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T01:32:35.963389Z, time_modified: 2024-11-19T01:32:35.963389Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "230b491903daebcaf87cf435ebe6f0a0535f8ff306b818acc1839c538f57b468" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, db_silo: Silo { identity: SiloIdentity { id: 7ae1255b-c149-4b2a-8f4e-7489cdeaaefa, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-19T01:32:35.963389Z, time_modified: 2024-11-19T01:32:35.963389Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "230b491903daebcaf87cf435ebe6f0a0535f8ff306b818acc1839c538f57b468" }] }) }
23702024-11-19T01:46:34.395ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 158.932143ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa","tls_certs":["230b491903daebcaf87cf435ebe6f0a0535f8ff306b818acc1839c538f57b468"]}},"default_endpoint":{"silo_id":"7ae1255b-c149-4b2a-8f4e-7489cdeaaefa","tls_certs":["230b491903daebcaf87cf435ebe6f0a0535f8ff306b818acc1839c538f57b468"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
23712024-11-19T01:46:34.412ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 176.16648ms iteration = 31 status = {"physical_disks_added":0}
23722024-11-19T01:46:34.419ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
23732024-11-19T01:46:34.419ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 182.85234ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
23742024-11-19T01:46:34.491ZINFOnexus (BackgroundTasks): VPC route manager sled 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
23752024-11-19T01:46:34.491ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
23762024-11-19T01:46:34.491ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ffa519e-a6a1-4ad1-9997-a819f829f848", "content-length": "372", "date": "Tue, 19 Nov 2024 01:46:33 GMT"} })
23772024-11-19T01:46:34.491ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23782024-11-19T01:46:34.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23792024-11-19T01:46:34.500ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1139 zone_address = fd00:1122:3344:101::2
23802024-11-19T01:46:34.500ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
23812024-11-19T01:46:34.501ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a13525c-d92c-474b-a021-da69bd75786a", "content-length": "26", "date": "Tue, 19 Nov 2024 01:46:33 GMT"} })
23822024-11-19T01:46:34.501ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1144 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
23832024-11-19T01:46:34.504ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
23842024-11-19T01:46:34.516ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
23852024-11-19T01:46:34.516ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
23862024-11-19T01:46:34.517ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e415d9e8-fe29-4803-bc78-7df0ffcaa6a3", "date": "Tue, 19 Nov 2024 01:46:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23872024-11-19T01:46:34.517ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23882024-11-19T01:46:34.518ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "688f5d7d-fc13-4836-ba34-f95094648116", "date": "Tue, 19 Nov 2024 01:46:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23892024-11-19T01:46:34.518ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23902024-11-19T01:46:34.520ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
23912024-11-19T01:46:34.520ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 283.744114ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
23922024-11-19T01:46:34.521ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23932024-11-19T01:46:34.522ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
23942024-11-19T01:46:34.522ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23952024-11-19T01:46:34.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
23962024-11-19T01:46:34.532ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 296.202037ms iteration = 29 status = {}
23972024-11-19T01:46:34.533ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
23982024-11-19T01:46:34.533ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
23992024-11-19T01:46:34.534ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4fc0adcf-22f9-4286-8c73-626541851230", "date": "Tue, 19 Nov 2024 01:46:33 GMT"} })
24002024-11-19T01:46:34.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24012024-11-19T01:46:34.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24022024-11-19T01:46:34.534ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1139 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 zone_address = fd00:1122:3344:101::2
24032024-11-19T01:46:34.534ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24042024-11-19T01:46:34.534ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a6ff454-4a23-47bc-9e5a-1509ac6b7a93", "content-length": "26", "date": "Tue, 19 Nov 2024 01:46:33 GMT"} })
24052024-11-19T01:46:34.534ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1144 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24062024-11-19T01:46:34.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24072024-11-19T01:46:34.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24082024-11-19T01:46:34.537ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1176 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49
24092024-11-19T01:46:34.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24102024-11-19T01:46:34.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24112024-11-19T01:46:34.544ZINFOnexus (BackgroundTasks): VPC route manager sled 302245ee-8785-4baf-86ed-0823410907ec push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
24122024-11-19T01:46:34.545ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24132024-11-19T01:46:34.545ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "374997a6-399d-498d-a80d-3147120c573e", "date": "Tue, 19 Nov 2024 01:46:33 GMT"} })
24142024-11-19T01:46:34.547ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 308.476306ms iteration = 32 status = {}
24152024-11-19T01:46:34.631ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24162024-11-19T01:46:34.631ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
24172024-11-19T01:46:34.632ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "77e3122e-fc91-4db6-a4ba-9cb188049df9", "content-length": "2", "date": "Tue, 19 Nov 2024 01:46:34 GMT"} })
24182024-11-19T01:46:34.632ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "29f92b0a-7750-45bf-be89-8c70ecde9bee", "date": "Tue, 19 Nov 2024 01:46:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
24192024-11-19T01:46:34.632ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
24202024-11-19T01:46:34.633ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "664566a9-4ff4-476c-b4fd-f0b72ca437c5", "date": "Tue, 19 Nov 2024 01:46:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
24212024-11-19T01:46:34.633ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
24222024-11-19T01:46:34.634ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24232024-11-19T01:46:34.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24242024-11-19T01:46:34.635ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a2329b33-3b25-4a05-b8e6-d90512b081ab", "date": "Tue, 19 Nov 2024 01:46:34 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
24252024-11-19T01:46:34.635ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
24262024-11-19T01:46:34.636ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 399.618767ms iteration = 29 status = null
24272024-11-19T01:46:34.637ZDEBGnexus (BackgroundTasks): client request SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24282024-11-19T01:46:34.637ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
24292024-11-19T01:46:34.637ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 401.025512ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24302024-11-19T01:46:34.637ZDEBGnexus (BackgroundTasks): client response SledAgent = 302245ee-8785-4baf-86ed-0823410907ec background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9579ea09-9230-440b-a679-f20521cabcc5", "content-length": "691", "date": "Tue, 19 Nov 2024 01:46:33 GMT"} })
24312024-11-19T01:46:34.637ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24322024-11-19T01:46:34.637ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24332024-11-19T01:46:34.637ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24342024-11-19T01:46:34.640ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 403.328853ms iteration = 31 status = {}
24352024-11-19T01:46:34.698ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24362024-11-19T01:46:34.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24372024-11-19T01:46:34.700ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 2ed5d87d-b512-430b-8a9f-5bee05700135, rack_id: cbab7bfb-8e8e-44f1-a93b-b95de3b50f49, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(a8b5b6ed-8c4b-4b6d-a2dc-17e991abb0cd) } rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch_location = Switch0
24382024-11-19T01:46:34.700ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24392024-11-19T01:46:34.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24402024-11-19T01:46:34.709ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
24412024-11-19T01:46:34.709ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4fc3b44-78b6-4b73-9644-a2b8fdaefb39", "content-length": "134", "date": "Tue, 19 Nov 2024 01:46:34 GMT"} })
24422024-11-19T01:46:34.709ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
24432024-11-19T01:46:34.709ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = a8b5b6ed-8c4b-4b6d-a2dc-17e991abb0cd
24442024-11-19T01:46:34.709ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
24452024-11-19T01:46:34.709ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
24462024-11-19T01:46:34.709ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24472024-11-19T01:46:34.709ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24482024-11-19T01:46:34.709ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24492024-11-19T01:46:34.709ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24502024-11-19T01:46:34.709ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
24512024-11-19T01:46:34.709ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
24522024-11-19T01:46:34.710ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49
24532024-11-19T01:46:34.710ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24542024-11-19T01:46:34.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24552024-11-19T01:46:34.712ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
24562024-11-19T01:46:34.712ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2347a7a-60ae-4307-8d10-929e8c01a908", "content-length": "2", "date": "Tue, 19 Nov 2024 01:46:34 GMT"} })
24572024-11-19T01:46:34.712ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
24582024-11-19T01:46:34.712ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "be17f8c3-29dc-412b-b58c-28c06a90c18a", "content-length": "51", "date": "Tue, 19 Nov 2024 01:46:34 GMT"} })
24592024-11-19T01:46:34.712ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch_location = Switch0
24602024-11-19T01:46:34.712ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
24612024-11-19T01:46:34.813ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ff38960d-0426-4e09-8350-bc7d3766a520", "date": "Tue, 19 Nov 2024 01:46:33 GMT"} })
24622024-11-19T01:46:34.813ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 switch = Switch0
24632024-11-19T01:46:34.813ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
24642024-11-19T01:46:34.813ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cbab7bfb-8e8e-44f1-a93b-b95de3b50f49 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fee5beaf-6eae-4b52-bc0e-9713b2dcf9bf", "content-length": "682", "date": "Tue, 19 Nov 2024 01:46:33 GMT"} })
24652024-11-19T01:46:34.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24662024-11-19T01:46:34.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24672024-11-19T01:46:34.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24682024-11-19T01:46:34.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24692024-11-19T01:46:34.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24702024-11-19T01:46:34.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24712024-11-19T01:46:34.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24722024-11-19T01:46:34.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24732024-11-19T01:46:34.831ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 594.991729ms iteration = 29 status = {}
24742024-11-19T01:46:41.812ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::a]:61083 method = GET remote_addr = [fd00:1122:3344:101::d]:34824 req_id = d7ae4423-cc1e-4be2-891a-48fa1a721015 response_code = 200 uri = /7dcf0d8a-40d8-45f8-a6f1-d545f08c056b