Max level shown:
12024-10-10T04:30:00.798ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 70.726189ms file = nexus/src/app/crucible.rs:827 region_id = bf7a22b7-7292-4130-938e-e8cdddef6329 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845 saga_name = disk-delete
22024-10-10T04:30:00.846ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 7e0622f1-180b-4ef2-8356-944f7831b78d saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845 saga_name = disk-delete
32024-10-10T04:30:00.873ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = bf7a22b7-7292-4130-938e-e8cdddef6329 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845 saga_name = disk-delete
42024-10-10T04:30:00.912ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 8da712fa-aab6-48f3-84f3-923e2d00385e saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845 saga_name = disk-delete
52024-10-10T04:30:00.952ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
62024-10-10T04:30:00.952ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
72024-10-10T04:30:00.963ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
82024-10-10T04:30:00.963ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
92024-10-10T04:30:00.971ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
102024-10-10T04:30:00.971ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
112024-10-10T04:30:00.978ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
122024-10-10T04:30:00.978ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
132024-10-10T04:30:00.985ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
142024-10-10T04:30:00.985ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
152024-10-10T04:30:00.990ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
162024-10-10T04:30:00.990ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
172024-10-10T04:30:01.009ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
182024-10-10T04:30:01.009ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 9 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
192024-10-10T04:30:01.015ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
202024-10-10T04:30:01.015ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
212024-10-10T04:30:01.023ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
222024-10-10T04:30:01.023ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
232024-10-10T04:30:01.028ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
242024-10-10T04:30:01.028ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
252024-10-10T04:30:01.037ZINFOnexus (SagaExecutor): allocated regions for be6afd38-3fc0-4ffe-a463-29b317e06ea4 is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:546 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845 saga_name = disk-delete
262024-10-10T04:30:01.046ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
272024-10-10T04:30:01.046ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
282024-10-10T04:30:01.054ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
292024-10-10T04:30:01.054ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
302024-10-10T04:30:01.059ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
312024-10-10T04:30:01.059ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
322024-10-10T04:30:01.066ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
332024-10-10T04:30:01.066ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
342024-10-10T04:30:01.070ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
352024-10-10T04:30:01.070ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
362024-10-10T04:30:01.077ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845 sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
372024-10-10T04:30:01.077ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845
382024-10-10T04:30:01.089ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845 saga_name = disk-delete sec_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
392024-10-10T04:30:01.089ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 49da4a25-f69e-4418-9f9a-05e83a496845 saga_name = disk-delete saga_result = SagaResult { saga_id: 49da4a25-f69e-4418-9f9a-05e83a496845, saga_log: SagaLog { saga_id: 49da4a25-f69e-4418-9f9a-05e83a496845, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N006 started, N005 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": String("56e6f41a-7b56-4a5a-9905-d6ced432efa7"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("fdb136a3-acb2-474c-bffc-200c51c66f6f"), "name": String("disk-3ba8e5b1d2f"), "time_created": String("2024-10-10T04:29:32.656609Z"), "time_deleted": Null, "time_modified": String("2024-10-10T04:29:32.656609Z")}, "pantry_address": Null, "project_id": String("a966fe35-7bda-4980-9e22-e5bc4538ba16"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-10-10T04:29:33.696709Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("be6afd38-3fc0-4ffe-a463-29b317e06ea4")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("1104c51c-4e42-4c05-99d9-0e655da0191e"), "silo_user_id": String("c4031d11-3a27-48a3-984d-c3310a5321c7")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("be6afd38-3fc0-4ffe-a463-29b317e06ea4")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("7e0622f1-180b-4ef2-8356-944f7831b78d"), String("8da712fa-aab6-48f3-84f3-923e2d00385e"), String("bf7a22b7-7292-4130-938e-e8cdddef6329")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Array []), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("7e0622f1-180b-4ef2-8356-944f7831b78d"), String("8da712fa-aab6-48f3-84f3-923e2d00385e"), String("bf7a22b7-7292-4130-938e-e8cdddef6329")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": String("56e6f41a-7b56-4a5a-9905-d6ced432efa7"), "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("fdb136a3-acb2-474c-bffc-200c51c66f6f"), "name": String("disk-3ba8e5b1d2f"), "time_created": String("2024-10-10T04:29:32.656609Z"), "time_deleted": Null, "time_modified": String("2024-10-10T04:29:32.656609Z")}, "pantry_address": Null, "project_id": String("a966fe35-7bda-4980-9e22-e5bc4538ba16"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-10-10T04:29:33.696709Z")}, "size": Number(2147483648), "slot": Null, "volume_id": String("be6afd38-3fc0-4ffe-a463-29b317e06ea4")}, "freed_crucible_regions": Array [], "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("1104c51c-4e42-4c05-99d9-0e655da0191e"), "silo_user_id": String("c4031d11-3a27-48a3-984d-c3310a5321c7")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("be6afd38-3fc0-4ffe-a463-29b317e06ea4")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
402024-10-10T04:30:01.089ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 811758 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 8f0ce6b5-9508-4d21-9608-5f61b57c0e06 response_code = 204 uri = /v1/disks/disk-3ba8e5b1d2f?project=proj-f201b581116
412024-10-10T04:30:01.091ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
422024-10-10T04:30:01.091ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
432024-10-10T04:30:01.092ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
442024-10-10T04:30:01.093ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
452024-10-10T04:30:01.095ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
462024-10-10T04:30:01.096ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "a431bfb5c722ba9d1496dfed447b88b6a91a4818", lookup_type: ByCompositeId("token = \\"a431bfb5c722ba9d1496dfed447b88b6a91a4818\\"") } result = Ok(())
472024-10-10T04:30:01.096ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
482024-10-10T04:30:01.096ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
492024-10-10T04:30:01.098ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
502024-10-10T04:30:01.098ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
512024-10-10T04:30:01.100ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
522024-10-10T04:30:01.100ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
532024-10-10T04:30:01.101ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
542024-10-10T04:30:01.101ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
552024-10-10T04:30:01.103ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
562024-10-10T04:30:01.104ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) }, key: c4031d11-3a27-48a3-984d-c3310a5321c7, lookup_type: ById(c4031d11-3a27-48a3-984d-c3310a5321c7) } result = Ok(())
572024-10-10T04:30:01.104ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
582024-10-10T04:30:01.104ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
592024-10-10T04:30:01.106ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
602024-10-10T04:30:01.107ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "a431bfb5c722ba9d1496dfed447b88b6a91a4818", lookup_type: ByCompositeId("a431bfb5c722ba9d1496dfed447b88b6a91a4818") } result = Ok(())
612024-10-10T04:30:01.107ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
622024-10-10T04:30:01.107ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
632024-10-10T04:30:01.112ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
642024-10-10T04:30:01.113ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
652024-10-10T04:30:01.114ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
662024-10-10T04:30:01.114ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
672024-10-10T04:30:01.116ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
682024-10-10T04:30:01.116ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
692024-10-10T04:30:01.117ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
702024-10-10T04:30:01.118ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
712024-10-10T04:30:01.119ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
722024-10-10T04:30:01.120ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) }, key: c4031d11-3a27-48a3-984d-c3310a5321c7, lookup_type: ById(c4031d11-3a27-48a3-984d-c3310a5321c7) } result = Ok(())
732024-10-10T04:30:01.120ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
742024-10-10T04:30:01.120ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
752024-10-10T04:30:01.122ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
762024-10-10T04:30:01.122ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
772024-10-10T04:30:01.124ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
782024-10-10T04:30:01.124ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
792024-10-10T04:30:01.126ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
802024-10-10T04:30:01.127ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) } result = Ok(())
812024-10-10T04:30:01.127ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
822024-10-10T04:30:01.127ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
832024-10-10T04:30:01.128ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
842024-10-10T04:30:01.129ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
852024-10-10T04:30:01.130ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
862024-10-10T04:30:01.131ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
872024-10-10T04:30:01.132ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
882024-10-10T04:30:01.133ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
892024-10-10T04:30:01.135ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
902024-10-10T04:30:01.135ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
912024-10-10T04:30:01.137ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
922024-10-10T04:30:01.137ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
932024-10-10T04:30:01.140ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
942024-10-10T04:30:01.140ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
952024-10-10T04:30:01.143ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
962024-10-10T04:30:01.143ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
972024-10-10T04:30:01.146ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {(Silo, 1104c51c-4e42-4c05-99d9-0e655da0191e, "admin")} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
982024-10-10T04:30:01.149ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) }, key: a966fe35-7bda-4980-9e22-e5bc4538ba16, lookup_type: ByName("proj-f201b581116") }, key: 1b014a10-cf72-46d2-b56e-2cafb97b6bbb, lookup_type: ByName("default") }, key: b23ed36e-d2dc-44bf-8a1e-923e4da4c987, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
992024-10-10T04:30:01.149ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1002024-10-10T04:30:01.149ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1012024-10-10T04:30:01.152ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1022024-10-10T04:30:01.152ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1032024-10-10T04:30:01.154ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1042024-10-10T04:30:01.155ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1052024-10-10T04:30:01.157ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1062024-10-10T04:30:01.157ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1072024-10-10T04:30:01.160ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {(Silo, 1104c51c-4e42-4c05-99d9-0e655da0191e, "admin")} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1082024-10-10T04:30:01.163ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) }, key: a966fe35-7bda-4980-9e22-e5bc4538ba16, lookup_type: ByName("proj-f201b581116") }, key: 1b014a10-cf72-46d2-b56e-2cafb97b6bbb, lookup_type: ByName("default") }, key: b23ed36e-d2dc-44bf-8a1e-923e4da4c987, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1092024-10-10T04:30:01.163ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1102024-10-10T04:30:01.163ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1112024-10-10T04:30:01.165ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1122024-10-10T04:30:01.166ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1132024-10-10T04:30:01.176ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1142024-10-10T04:30:01.176ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1152024-10-10T04:30:01.194ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1162024-10-10T04:30:01.194ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1172024-10-10T04:30:01.203ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 111931 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 1e46e5a5-35fb-4c76-a65a-5bc8e29ce07e response_code = 204 uri = /v1/vpc-subnets/default?project=proj-f201b581116&vpc=default
1182024-10-10T04:30:01.203ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Signaled
1192024-10-10T04:30:01.203ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1202024-10-10T04:30:01.203ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1212024-10-10T04:30:01.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1222024-10-10T04:30:01.204ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1232024-10-10T04:30:01.204ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1242024-10-10T04:30:01.205ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1252024-10-10T04:30:01.205ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1262024-10-10T04:30:01.205ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1272024-10-10T04:30:01.206ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1282024-10-10T04:30:01.206ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1292024-10-10T04:30:01.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1302024-10-10T04:30:01.207ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1312024-10-10T04:30:01.207ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1322024-10-10T04:30:01.208ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "a431bfb5c722ba9d1496dfed447b88b6a91a4818", lookup_type: ByCompositeId("token = \\"a431bfb5c722ba9d1496dfed447b88b6a91a4818\\"") } result = Ok(())
1332024-10-10T04:30:01.208ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1342024-10-10T04:30:01.208ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1352024-10-10T04:30:01.209ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1362024-10-10T04:30:01.209ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1372024-10-10T04:30:01.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1382024-10-10T04:30:01.210ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1392024-10-10T04:30:01.210ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1402024-10-10T04:30:01.211ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1412024-10-10T04:30:01.212ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1422024-10-10T04:30:01.213ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1432024-10-10T04:30:01.213ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1442024-10-10T04:30:01.214ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1452024-10-10T04:30:01.216ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) }, key: c4031d11-3a27-48a3-984d-c3310a5321c7, lookup_type: ById(c4031d11-3a27-48a3-984d-c3310a5321c7) } result = Ok(())
1462024-10-10T04:30:01.216ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1472024-10-10T04:30:01.216ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1482024-10-10T04:30:01.217ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1492024-10-10T04:30:01.218ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "a431bfb5c722ba9d1496dfed447b88b6a91a4818", lookup_type: ByCompositeId("a431bfb5c722ba9d1496dfed447b88b6a91a4818") } result = Ok(())
1502024-10-10T04:30:01.218ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1512024-10-10T04:30:01.219ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1522024-10-10T04:30:01.225ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1532024-10-10T04:30:01.225ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1542024-10-10T04:30:01.227ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1552024-10-10T04:30:01.227ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1562024-10-10T04:30:01.228ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1572024-10-10T04:30:01.229ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1582024-10-10T04:30:01.230ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1592024-10-10T04:30:01.230ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1602024-10-10T04:30:01.231ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1612024-10-10T04:30:01.233ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) }, key: c4031d11-3a27-48a3-984d-c3310a5321c7, lookup_type: ById(c4031d11-3a27-48a3-984d-c3310a5321c7) } result = Ok(())
1622024-10-10T04:30:01.233ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1632024-10-10T04:30:01.233ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1642024-10-10T04:30:01.235ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1652024-10-10T04:30:01.235ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1662024-10-10T04:30:01.237ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
1672024-10-10T04:30:01.237ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
1682024-10-10T04:30:01.238ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
1692024-10-10T04:30:01.240ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) } result = Ok(())
1702024-10-10T04:30:01.240ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
1712024-10-10T04:30:01.240ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
1722024-10-10T04:30:01.242ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
1732024-10-10T04:30:01.243ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
1742024-10-10T04:30:01.244ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
1752024-10-10T04:30:01.245ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
1762024-10-10T04:30:01.250ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
1772024-10-10T04:30:01.250ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
1782024-10-10T04:30:01.253ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
1792024-10-10T04:30:01.253ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
1802024-10-10T04:30:01.256ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
1812024-10-10T04:30:01.256ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
1822024-10-10T04:30:01.258ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
1832024-10-10T04:30:01.258ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
1842024-10-10T04:30:01.261ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {(Silo, 1104c51c-4e42-4c05-99d9-0e655da0191e, "admin")} } uri = /v1/vpcs/default?project=proj-f201b581116
1852024-10-10T04:30:01.264ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) }, key: a966fe35-7bda-4980-9e22-e5bc4538ba16, lookup_type: ByName("proj-f201b581116") }, key: 1b014a10-cf72-46d2-b56e-2cafb97b6bbb, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
1862024-10-10T04:30:01.264ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
1872024-10-10T04:30:01.264ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
1882024-10-10T04:30:01.267ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
1892024-10-10T04:30:01.268ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
1902024-10-10T04:30:01.270ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
1912024-10-10T04:30:01.271ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
1922024-10-10T04:30:01.273ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
1932024-10-10T04:30:01.273ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
1942024-10-10T04:30:01.275ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {(Silo, 1104c51c-4e42-4c05-99d9-0e655da0191e, "admin")} } uri = /v1/vpcs/default?project=proj-f201b581116
1952024-10-10T04:30:01.278ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) }, key: a966fe35-7bda-4980-9e22-e5bc4538ba16, lookup_type: ByName("proj-f201b581116") }, key: 1b014a10-cf72-46d2-b56e-2cafb97b6bbb, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
1962024-10-10T04:30:01.278ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
1972024-10-10T04:30:01.278ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
1982024-10-10T04:30:01.280ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
1992024-10-10T04:30:01.280ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2002024-10-10T04:30:01.313ZINFOnexus (BackgroundTasks): VPC route manager sled 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2012024-10-10T04:30:01.313ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2022024-10-10T04:30:01.313ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1880cf84-c984-49e5-9b3e-a1e282e7c6ab", "content-length": "372", "date": "Thu, 10 Oct 2024 04:30:00 GMT"} })
2032024-10-10T04:30:01.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2042024-10-10T04:30:01.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2052024-10-10T04:30:01.321ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
2062024-10-10T04:30:01.322ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2072024-10-10T04:30:01.325ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
2082024-10-10T04:30:01.325ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2092024-10-10T04:30:01.327ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
2102024-10-10T04:30:01.327ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2112024-10-10T04:30:01.329ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
2122024-10-10T04:30:01.329ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
2132024-10-10T04:30:01.329ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "725c3f81-5847-45cb-8981-2baa99723745", "date": "Thu, 10 Oct 2024 04:30:00 GMT"} })
2142024-10-10T04:30:01.329ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2152024-10-10T04:30:01.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2162024-10-10T04:30:01.330ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
2172024-10-10T04:30:01.330ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2182024-10-10T04:30:01.332ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2192024-10-10T04:30:01.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2202024-10-10T04:30:01.333ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {(Silo, 1104c51c-4e42-4c05-99d9-0e655da0191e, "admin")} } uri = /v1/vpcs/default?project=proj-f201b581116
2212024-10-10T04:30:01.335ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2222024-10-10T04:30:01.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2232024-10-10T04:30:01.336ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) }, key: a966fe35-7bda-4980-9e22-e5bc4538ba16, lookup_type: ByName("proj-f201b581116") }, key: 1b014a10-cf72-46d2-b56e-2cafb97b6bbb, lookup_type: ByName("default") }, key: 1b692796-42f4-452f-8676-bf9ae674e341, lookup_type: ById(1b692796-42f4-452f-8676-bf9ae674e341) } result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2242024-10-10T04:30:01.336ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
2252024-10-10T04:30:01.337ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2262024-10-10T04:30:01.337ZINFOnexus (BackgroundTasks): VPC route manager sled 9772f104-f050-4d64-ad07-7e3347035f74 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
2272024-10-10T04:30:01.337ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2282024-10-10T04:30:01.338ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "53aad6b5-53b6-41da-9bfb-60d50f30e487", "date": "Thu, 10 Oct 2024 04:30:00 GMT"} })
2292024-10-10T04:30:01.340ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 137.561415ms iteration = 13 status = {}
2302024-10-10T04:30:01.344ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
2312024-10-10T04:30:01.344ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2322024-10-10T04:30:01.353ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
2332024-10-10T04:30:01.353ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2342024-10-10T04:30:01.356ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
2352024-10-10T04:30:01.356ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2362024-10-10T04:30:01.359ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
2372024-10-10T04:30:01.359ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2382024-10-10T04:30:01.361ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
2392024-10-10T04:30:01.361ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2402024-10-10T04:30:01.364ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
2412024-10-10T04:30:01.364ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2422024-10-10T04:30:01.367ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {(Silo, 1104c51c-4e42-4c05-99d9-0e655da0191e, "admin")} } uri = /v1/vpcs/default?project=proj-f201b581116
2432024-10-10T04:30:01.370ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) }, key: a966fe35-7bda-4980-9e22-e5bc4538ba16, lookup_type: ByName("proj-f201b581116") }, key: 1b014a10-cf72-46d2-b56e-2cafb97b6bbb, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2442024-10-10T04:30:01.370ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-f201b581116
2452024-10-10T04:30:01.370ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-f201b581116
2462024-10-10T04:30:01.377ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 173597 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 9acfd114-0201-4120-a02c-598fa78c8d40 response_code = 204 uri = /v1/vpcs/default?project=proj-f201b581116
2472024-10-10T04:30:01.378ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2482024-10-10T04:30:01.378ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2492024-10-10T04:30:01.380ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2502024-10-10T04:30:01.380ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2512024-10-10T04:30:01.381ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2522024-10-10T04:30:01.382ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "a431bfb5c722ba9d1496dfed447b88b6a91a4818", lookup_type: ByCompositeId("token = \\"a431bfb5c722ba9d1496dfed447b88b6a91a4818\\"") } result = Ok(())
2532024-10-10T04:30:01.382ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2542024-10-10T04:30:01.383ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2552024-10-10T04:30:01.384ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2562024-10-10T04:30:01.384ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2572024-10-10T04:30:01.385ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2582024-10-10T04:30:01.386ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2592024-10-10T04:30:01.387ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2602024-10-10T04:30:01.387ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2612024-10-10T04:30:01.389ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2622024-10-10T04:30:01.390ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) }, key: c4031d11-3a27-48a3-984d-c3310a5321c7, lookup_type: ById(c4031d11-3a27-48a3-984d-c3310a5321c7) } result = Ok(())
2632024-10-10T04:30:01.390ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2642024-10-10T04:30:01.390ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2652024-10-10T04:30:01.391ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2662024-10-10T04:30:01.392ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "a431bfb5c722ba9d1496dfed447b88b6a91a4818", lookup_type: ByCompositeId("a431bfb5c722ba9d1496dfed447b88b6a91a4818") } result = Ok(())
2672024-10-10T04:30:01.392ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2682024-10-10T04:30:01.392ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2692024-10-10T04:30:01.400ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2702024-10-10T04:30:01.400ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2712024-10-10T04:30:01.401ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2722024-10-10T04:30:01.402ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2732024-10-10T04:30:01.403ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2742024-10-10T04:30:01.403ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2752024-10-10T04:30:01.405ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2762024-10-10T04:30:01.405ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2772024-10-10T04:30:01.406ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2782024-10-10T04:30:01.407ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) }, key: c4031d11-3a27-48a3-984d-c3310a5321c7, lookup_type: ById(c4031d11-3a27-48a3-984d-c3310a5321c7) } result = Ok(())
2792024-10-10T04:30:01.407ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2802024-10-10T04:30:01.407ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2812024-10-10T04:30:01.409ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2822024-10-10T04:30:01.409ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2832024-10-10T04:30:01.411ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
2842024-10-10T04:30:01.411ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
2852024-10-10T04:30:01.412ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
2862024-10-10T04:30:01.413ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) } result = Ok(())
2872024-10-10T04:30:01.413ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
2882024-10-10T04:30:01.413ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
2892024-10-10T04:30:01.415ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
2902024-10-10T04:30:01.415ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
2912024-10-10T04:30:01.417ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
2922024-10-10T04:30:01.417ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
2932024-10-10T04:30:01.420ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
2942024-10-10T04:30:01.420ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
2952024-10-10T04:30:01.423ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
2962024-10-10T04:30:01.423ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
2972024-10-10T04:30:01.425ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
2982024-10-10T04:30:01.425ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
2992024-10-10T04:30:01.428ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {(Silo, 1104c51c-4e42-4c05-99d9-0e655da0191e, "admin")} } uri = /v1/projects/proj-f201b581116
3002024-10-10T04:30:01.430ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Project { parent: Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) }, key: a966fe35-7bda-4980-9e22-e5bc4538ba16, lookup_type: ByName("proj-f201b581116") } result = Ok(()) uri = /v1/projects/proj-f201b581116
3012024-10-10T04:30:01.430ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
3022024-10-10T04:30:01.430ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
3032024-10-10T04:30:01.432ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
3042024-10-10T04:30:01.432ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
3052024-10-10T04:30:01.435ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
3062024-10-10T04:30:01.435ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
3072024-10-10T04:30:01.438ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
3082024-10-10T04:30:01.438ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
3092024-10-10T04:30:01.440ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {(Silo, 1104c51c-4e42-4c05-99d9-0e655da0191e, "admin")} } uri = /v1/projects/proj-f201b581116
3102024-10-10T04:30:01.442ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Project { parent: Silo { parent: Fleet, key: 1104c51c-4e42-4c05-99d9-0e655da0191e, lookup_type: ById(1104c51c-4e42-4c05-99d9-0e655da0191e) }, key: a966fe35-7bda-4980-9e22-e5bc4538ba16, lookup_type: ByName("proj-f201b581116") } result = Ok(()) uri = /v1/projects/proj-f201b581116
3112024-10-10T04:30:01.442ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
3122024-10-10T04:30:01.442ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
3132024-10-10T04:30:01.445ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
3142024-10-10T04:30:01.445ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
3152024-10-10T04:30:01.447ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
3162024-10-10T04:30:01.447ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
3172024-10-10T04:30:01.465ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
3182024-10-10T04:30:01.465ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
3192024-10-10T04:30:01.480ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
3202024-10-10T04:30:01.480ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
3212024-10-10T04:30:01.483ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
3222024-10-10T04:30:01.483ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
3232024-10-10T04:30:01.485ZDEBGnexus (dropshot_external): roles actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc roles = RoleSet { roles: {} } uri = /v1/projects/proj-f201b581116
3242024-10-10T04:30:01.485ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: c4031d11-3a27-48a3-984d-c3310a5321c7, silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, .. }) actor_id = c4031d11-3a27-48a3-984d-c3310a5321c7 authenticated = true local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc resource = Database result = Ok(()) uri = /v1/projects/proj-f201b581116
3252024-10-10T04:30:01.501ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 123207 local_addr = 172.30.2.5:443 method = DELETE remote_addr = 10.151.2.100:58414 req_id = 766c1916-b266-4592-a2c6-0c7feaafe5bc response_code = 204 uri = /v1/projects/proj-f201b581116
3262024-10-10T04:30:04.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
3272024-10-10T04:30:04.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
3282024-10-10T04:30:04.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3292024-10-10T04:30:04.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3302024-10-10T04:30:04.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3312024-10-10T04:30:04.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3322024-10-10T04:30:04.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3332024-10-10T04:30:04.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3342024-10-10T04:30:04.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3352024-10-10T04:30:04.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3362024-10-10T04:30:04.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3372024-10-10T04:30:04.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3382024-10-10T04:30:04.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3392024-10-10T04:30:04.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1ba4e165-7586-4255-a320-af3c6bf6137c, lookup_type: ById(1ba4e165-7586-4255-a320-af3c6bf6137c) } result = Ok(())
3402024-10-10T04:30:04.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3412024-10-10T04:30:04.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3422024-10-10T04:30:04.552ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c original_time_created = 2024-10-10 04:25:36.941399 UTC target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c time_created = 2024-10-10 04:25:36.941399 UTC
3432024-10-10T04:30:04.552ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.646248ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1ba4e165-7586-4255-a320-af3c6bf6137c","time_created":"2024-10-10T04:25:36.941399Z"}
3442024-10-10T04:30:04.560ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3452024-10-10T04:30:04.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3462024-10-10T04:30:04.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.241435ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3472024-10-10T04:30:07.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2385 local_addr = [fd00:1122:3344:101::a]:52536 method = GET remote_addr = [fd00:1122:3344:101::d]:49035 req_id = dfa736cc-d8ee-4f09-bbbf-b9d56fd93f00 response_code = 200 uri = /6428ed70-db9f-4da8-8d9d-b09c2dd1c036
3482024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
3492024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
3502024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
3512024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3522024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
3532024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.96\u{b5}s iteration = 10 status = {"errors":[],"records_set_to_done":[]}
3542024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
3552024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
3562024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
3572024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
3582024-10-10T04:30:14.533ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
3592024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3602024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3612024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
3622024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
3632024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
3642024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3652024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
3662024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
3672024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3682024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
3692024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
3702024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3712024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
3722024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3732024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
3742024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
3752024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
3762024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
3772024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
3782024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.381\u{b5}s iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
3792024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3802024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
3812024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.75\u{b5}s iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
3822024-10-10T04:30:14.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.41\u{b5}s iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3832024-10-10T04:30:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3842024-10-10T04:30:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3852024-10-10T04:30:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
3862024-10-10T04:30:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
3872024-10-10T04:30:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3882024-10-10T04:30:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
3892024-10-10T04:30:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3902024-10-10T04:30:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
3912024-10-10T04:30:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3922024-10-10T04:30:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3932024-10-10T04:30:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3942024-10-10T04:30:14.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3952024-10-10T04:30:14.536ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3962024-10-10T04:30:14.537ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.270999ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
3972024-10-10T04:30:14.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3982024-10-10T04:30:14.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3992024-10-10T04:30:14.538ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 13644, tv_nsec: 130856965 } })
4002024-10-10T04:30:14.538ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 13644, tv_nsec: 130910067 } })
4012024-10-10T04:30:14.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4022024-10-10T04:30:14.538ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4032024-10-10T04:30:14.539ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1052
4042024-10-10T04:30:14.539ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1052
4052024-10-10T04:30:14.539ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4062024-10-10T04:30:14.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4072024-10-10T04:30:14.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4082024-10-10T04:30:14.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
4092024-10-10T04:30:14.540ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4102024-10-10T04:30:14.540ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4112024-10-10T04:30:14.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4122024-10-10T04:30:14.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4132024-10-10T04:30:14.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
4142024-10-10T04:30:14.543ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4152024-10-10T04:30:14.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4162024-10-10T04:30:14.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
4172024-10-10T04:30:14.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4182024-10-10T04:30:14.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4192024-10-10T04:30:14.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4202024-10-10T04:30:14.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4212024-10-10T04:30:14.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4222024-10-10T04:30:14.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4232024-10-10T04:30:14.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4242024-10-10T04:30:14.548ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4252024-10-10T04:30:14.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4262024-10-10T04:30:14.549ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4272024-10-10T04:30:14.549ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4282024-10-10T04:30:14.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4292024-10-10T04:30:14.549ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 16.248626ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
4302024-10-10T04:30:14.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4312024-10-10T04:30:14.554ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
4322024-10-10T04:30:14.554ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.590085ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
4332024-10-10T04:30:14.559ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4342024-10-10T04:30:14.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4352024-10-10T04:30:14.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4362024-10-10T04:30:14.563ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4372024-10-10T04:30:14.563ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4382024-10-10T04:30:14.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4392024-10-10T04:30:14.564ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4402024-10-10T04:30:14.565ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4412024-10-10T04:30:14.565ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4422024-10-10T04:30:14.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4432024-10-10T04:30:14.565ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4442024-10-10T04:30:14.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4452024-10-10T04:30:14.567ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4462024-10-10T04:30:14.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4472024-10-10T04:30:14.568ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4482024-10-10T04:30:14.570ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4492024-10-10T04:30:14.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4502024-10-10T04:30:14.571ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9772f104-f050-4d64-ad07-7e3347035f74, lookup_type: ById(9772f104-f050-4d64-ad07-7e3347035f74) } result = Ok(())
4512024-10-10T04:30:14.571ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4522024-10-10T04:30:14.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4532024-10-10T04:30:14.573ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 39.800722ms iteration = 10 status = 0
4542024-10-10T04:30:14.574ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4552024-10-10T04:30:14.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4562024-10-10T04:30:14.575ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
4572024-10-10T04:30:14.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4582024-10-10T04:30:14.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4592024-10-10T04:30:14.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
4602024-10-10T04:30:14.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4612024-10-10T04:30:14.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4622024-10-10T04:30:14.577ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4632024-10-10T04:30:14.577ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4642024-10-10T04:30:14.577ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
4652024-10-10T04:30:14.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4662024-10-10T04:30:14.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4672024-10-10T04:30:14.578ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4682024-10-10T04:30:14.578ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 13644, tv_nsec: 171128950 } })
4692024-10-10T04:30:14.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
4702024-10-10T04:30:14.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4712024-10-10T04:30:14.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4722024-10-10T04:30:14.579ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1052 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a
4732024-10-10T04:30:14.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1ba4e165-7586-4255-a320-af3c6bf6137c, lookup_type: ById(1ba4e165-7586-4255-a320-af3c6bf6137c) } result = Ok(())
4742024-10-10T04:30:14.580ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4752024-10-10T04:30:14.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4762024-10-10T04:30:14.598ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.589452ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4772024-10-10T04:30:14.608ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
4782024-10-10T04:30:14.608ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
4792024-10-10T04:30:14.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4802024-10-10T04:30:14.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4812024-10-10T04:30:14.657ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1060 zone_address = fd00:1122:3344:101::2
4822024-10-10T04:30:14.657ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4832024-10-10T04:30:14.657ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "84953b4c-3f21-4cd0-abae-321cbc92688b", "content-length": "26", "date": "Thu, 10 Oct 2024 04:30:13 GMT"} })
4842024-10-10T04:30:14.657ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1065 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4852024-10-10T04:30:14.659ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1097 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4862024-10-10T04:30:14.720ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1060 zone_address = fd00:1122:3344:101::2
4872024-10-10T04:30:14.720ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4882024-10-10T04:30:14.720ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e2ba93f-9b71-48a5-9677-622796bacb96", "content-length": "26", "date": "Thu, 10 Oct 2024 04:30:13 GMT"} })
4892024-10-10T04:30:14.720ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1065 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4902024-10-10T04:30:14.721ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1097 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4912024-10-10T04:30:14.733ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1060 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a zone_address = fd00:1122:3344:101::2
4922024-10-10T04:30:14.733ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4932024-10-10T04:30:14.733ZINFOnexus (BackgroundTasks): VPC route manager sled 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
4942024-10-10T04:30:14.733ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4952024-10-10T04:30:14.734ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca0658d0-a941-4ab2-8512-2daaa88c14ae", "content-length": "26", "date": "Thu, 10 Oct 2024 04:30:13 GMT"} })
4962024-10-10T04:30:14.734ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1065 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4972024-10-10T04:30:14.734ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0137aaa4-42b6-48c5-9fdb-b859330333b1", "content-length": "372", "date": "Thu, 10 Oct 2024 04:30:14 GMT"} })
4982024-10-10T04:30:14.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4992024-10-10T04:30:14.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5002024-10-10T04:30:14.736ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1097 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fb9aa554-f959-49d5-975a-a4595288f00a
5012024-10-10T04:30:14.801ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
5022024-10-10T04:30:14.801ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b339d75-9f54-47f6-847c-02219247d9f2", "content-length": "2", "date": "Thu, 10 Oct 2024 04:30:14 GMT"} })
5032024-10-10T04:30:14.802ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5042024-10-10T04:30:14.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5052024-10-10T04:30:14.813ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
5062024-10-10T04:30:14.813ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 280.100746ms iteration = 12 status = {"physical_disks_added":0}
5072024-10-10T04:30:14.814ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "27f8f9b4-db5a-4e93-9028-19dd08c530e1", "content-length": "691", "date": "Thu, 10 Oct 2024 04:30:14 GMT"} })
5082024-10-10T04:30:14.814ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
5092024-10-10T04:30:14.814ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
5102024-10-10T04:30:14.814ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
5112024-10-10T04:30:14.815ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 282.150521ms iteration = 12 status = {}
5122024-10-10T04:30:14.817ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 283.635552ms iteration = 10 status = null
5132024-10-10T04:30:14.824ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c original_time_created = 2024-10-10 04:25:36.941399 UTC target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c time_created = 2024-10-10 04:25:36.941399 UTC
5142024-10-10T04:30:14.824ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 290.211023ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1ba4e165-7586-4255-a320-af3c6bf6137c","time_created":"2024-10-10T04:25:36.941399Z"}
5152024-10-10T04:30:14.828ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
5162024-10-10T04:30:14.828ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
5172024-10-10T04:30:14.828ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9f3a5082-c0d8-4147-b6aa-f70b35037726", "date": "Thu, 10 Oct 2024 04:30:14 GMT"} })
5182024-10-10T04:30:14.828ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5192024-10-10T04:30:14.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5202024-10-10T04:30:14.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5212024-10-10T04:30:14.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5222024-10-10T04:30:14.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5232024-10-10T04:30:14.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5242024-10-10T04:30:14.837ZINFOnexus (BackgroundTasks): VPC route manager sled 9772f104-f050-4d64-ad07-7e3347035f74 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
5252024-10-10T04:30:14.837ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
5262024-10-10T04:30:14.837ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8e5e72b3-0259-4fda-bf46-8dbc4bf962c8", "date": "Thu, 10 Oct 2024 04:30:14 GMT"} })
5272024-10-10T04:30:14.839ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 305.330768ms iteration = 14 status = {}
5282024-10-10T04:30:14.846ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5292024-10-10T04:30:14.846ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
5302024-10-10T04:30:14.846ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 313.0785ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
5312024-10-10T04:30:14.850ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 317.193823ms iteration = 10 status = {}
5322024-10-10T04:30:14.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5332024-10-10T04:30:14.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5342024-10-10T04:30:14.908ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ca93cde9-a76e-4d6d-8179-1b6e1a0745b6, rack_id: fb9aa554-f959-49d5-975a-a4595288f00a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2631167f-aa2a-400a-aa67-8033c4a469e6) } rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch_location = Switch0
5352024-10-10T04:30:14.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5362024-10-10T04:30:14.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5372024-10-10T04:30:14.918ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
5382024-10-10T04:30:14.919ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7eadb464-813c-4472-b134-bc250531cb76", "content-length": "121", "date": "Thu, 10 Oct 2024 04:30:14 GMT"} })
5392024-10-10T04:30:14.919ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
5402024-10-10T04:30:14.919ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2631167f-aa2a-400a-aa67-8033c4a469e6
5412024-10-10T04:30:14.919ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
5422024-10-10T04:30:14.919ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
5432024-10-10T04:30:14.919ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5442024-10-10T04:30:14.919ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5452024-10-10T04:30:14.919ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5462024-10-10T04:30:14.919ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5472024-10-10T04:30:14.919ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
5482024-10-10T04:30:14.919ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
5492024-10-10T04:30:14.919ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a
5502024-10-10T04:30:14.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5512024-10-10T04:30:14.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5522024-10-10T04:30:14.922ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
5532024-10-10T04:30:14.922ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f773b62a-83eb-4216-8e9e-c2b1067ac843", "content-length": "2", "date": "Thu, 10 Oct 2024 04:30:14 GMT"} })
5542024-10-10T04:30:14.922ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
5552024-10-10T04:30:14.922ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "11f034e6-8fe5-40d2-8af1-dad927a36362", "content-length": "52", "date": "Thu, 10 Oct 2024 04:30:14 GMT"} })
5562024-10-10T04:30:14.922ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch_location = Switch0
5572024-10-10T04:30:14.922ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
5582024-10-10T04:30:15.019ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "56720080-e1e9-431d-8675-40627a83a890", "date": "Thu, 10 Oct 2024 04:30:14 GMT"} })
5592024-10-10T04:30:15.019ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch = Switch0
5602024-10-10T04:30:15.019ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
5612024-10-10T04:30:15.019ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a5c11cf-0f2f-4f34-9b81-9d6cc890b1a9", "content-length": "669", "date": "Thu, 10 Oct 2024 04:30:15 GMT"} })
5622024-10-10T04:30:15.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5632024-10-10T04:30:15.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5642024-10-10T04:30:15.023ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5652024-10-10T04:30:15.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5662024-10-10T04:30:15.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5672024-10-10T04:30:15.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5682024-10-10T04:30:15.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5692024-10-10T04:30:15.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5702024-10-10T04:30:15.035ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 501.949282ms iteration = 10 status = {}
5712024-10-10T04:30:17.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2328 local_addr = [fd00:1122:3344:101::a]:52536 method = GET remote_addr = [fd00:1122:3344:101::d]:49035 req_id = 496d1d86-1b43-413e-9346-9a110ee30355 response_code = 200 uri = /6428ed70-db9f-4da8-8d9d-b09c2dd1c036
5722024-10-10T04:30:24.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
5732024-10-10T04:30:24.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5742024-10-10T04:30:24.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
5752024-10-10T04:30:24.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5762024-10-10T04:30:24.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5772024-10-10T04:30:24.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5782024-10-10T04:30:24.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5792024-10-10T04:30:24.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5802024-10-10T04:30:24.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5812024-10-10T04:30:24.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5822024-10-10T04:30:24.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5832024-10-10T04:30:24.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.784611ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5842024-10-10T04:30:24.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5852024-10-10T04:30:24.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5862024-10-10T04:30:24.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5872024-10-10T04:30:24.541ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5882024-10-10T04:30:24.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1ba4e165-7586-4255-a320-af3c6bf6137c, lookup_type: ById(1ba4e165-7586-4255-a320-af3c6bf6137c) } result = Ok(())
5892024-10-10T04:30:24.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5902024-10-10T04:30:24.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5912024-10-10T04:30:24.553ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c original_time_created = 2024-10-10 04:25:36.941399 UTC target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c time_created = 2024-10-10 04:25:36.941399 UTC
5922024-10-10T04:30:24.553ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.741719ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1ba4e165-7586-4255-a320-af3c6bf6137c","time_created":"2024-10-10T04:25:36.941399Z"}
5932024-10-10T04:30:27.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2263 local_addr = [fd00:1122:3344:101::a]:52536 method = GET remote_addr = [fd00:1122:3344:101::d]:49035 req_id = dc1954b0-cbb5-4941-b30a-b78f8b7131a8 response_code = 200 uri = /6428ed70-db9f-4da8-8d9d-b09c2dd1c036
5942024-10-10T04:30:29.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41151 req_id = ae0f2c5b-9126-40df-b5dc-99d40f6e9636 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/13?limit=100
5952024-10-10T04:30:29.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41151 req_id = ae0f2c5b-9126-40df-b5dc-99d40f6e9636 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/13?limit=100
5962024-10-10T04:30:29.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3514 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41151 req_id = ae0f2c5b-9126-40df-b5dc-99d40f6e9636 response_code = 200 uri = /nat/ipv4/changeset/13?limit=100
5972024-10-10T04:30:34.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
5982024-10-10T04:30:34.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
5992024-10-10T04:30:34.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6002024-10-10T04:30:34.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6012024-10-10T04:30:34.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6022024-10-10T04:30:34.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6032024-10-10T04:30:34.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6042024-10-10T04:30:34.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6052024-10-10T04:30:34.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6062024-10-10T04:30:34.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6072024-10-10T04:30:34.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6082024-10-10T04:30:34.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6092024-10-10T04:30:34.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6102024-10-10T04:30:34.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1ba4e165-7586-4255-a320-af3c6bf6137c, lookup_type: ById(1ba4e165-7586-4255-a320-af3c6bf6137c) } result = Ok(())
6112024-10-10T04:30:34.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6122024-10-10T04:30:34.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6132024-10-10T04:30:34.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c original_time_created = 2024-10-10 04:25:36.941399 UTC target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c time_created = 2024-10-10 04:25:36.941399 UTC
6142024-10-10T04:30:34.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.892761ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1ba4e165-7586-4255-a320-af3c6bf6137c","time_created":"2024-10-10T04:25:36.941399Z"}
6152024-10-10T04:30:34.561ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6162024-10-10T04:30:34.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6172024-10-10T04:30:34.563ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.902878ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6182024-10-10T04:30:37.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2128 local_addr = [fd00:1122:3344:101::a]:52536 method = GET remote_addr = [fd00:1122:3344:101::d]:49035 req_id = 3eaaa301-e7c4-4d56-b3b6-4c24f3bbd11b response_code = 200 uri = /6428ed70-db9f-4da8-8d9d-b09c2dd1c036
6192024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
6202024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
6212024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6222024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6232024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
6242024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 15.16\u{b5}s iteration = 11 status = {"errors":[],"records_set_to_done":[]}
6252024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
6262024-10-10T04:30:44.532ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
6272024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
6282024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
6292024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
6302024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6312024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6322024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
6332024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6342024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6352024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
6362024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6372024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
6382024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
6392024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6402024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
6412024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
6422024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
6432024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
6442024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
6452024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
6462024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6472024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6482024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.08\u{b5}s iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
6492024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
6502024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
6512024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
6522024-10-10T04:30:44.532ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
6532024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6542024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6552024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
6562024-10-10T04:30:44.532ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
6572024-10-10T04:30:44.532ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
6582024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6592024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
6602024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.161\u{b5}s iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6612024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
6622024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
6632024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
6642024-10-10T04:30:44.533ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-10 04:20:44.532879463 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
6652024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6662024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
6672024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
6682024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
6692024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6702024-10-10T04:30:44.533ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c
6712024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.58\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"1ba4e165-7586-4255-a320-af3c6bf6137c"}
6722024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
6732024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
6742024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 10.84\u{b5}s iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
6752024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6762024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
6772024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
6782024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6792024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
6802024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
6812024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
6822024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6832024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6842024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6852024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6862024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6872024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6882024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6892024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6902024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6912024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6922024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6932024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
6942024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6952024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6962024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
6972024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6982024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6992024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7002024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7012024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7022024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7032024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
7042024-10-10T04:30:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
7052024-10-10T04:30:44.534ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d31e501-c50e-4f36-b9cb-03903788e2aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("33ad8f93-2b4e-4f15-a193-986145855dbb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("33ad8f93-2b4e-4f15-a193-986145855dbb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 13674, tv_nsec: 126697281 } })
7062024-10-10T04:30:44.534ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6e4b104b-3153-4ae2-b17a-59d4ed30a709.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("95221550-ad50-418f-98e6-9e2141b25707.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9cad939d-13f3-4335-926c-49857d4c3b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9cad939d-13f3-4335-926c-49857d4c3b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 13674, tv_nsec: 126897707 } })
7072024-10-10T04:30:44.536ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
7082024-10-10T04:30:44.536ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.403113ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
7092024-10-10T04:30:44.536ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.432284ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
7102024-10-10T04:30:44.536ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7112024-10-10T04:30:44.536ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
7122024-10-10T04:30:44.536ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.187995ms iteration = 7 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
7132024-10-10T04:30:44.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7142024-10-10T04:30:44.537ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 13674, tv_nsec: 130164977 } })
7152024-10-10T04:30:44.537ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 13674, tv_nsec: 130281360 } })
7162024-10-10T04:30:44.537ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7172024-10-10T04:30:44.537ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1052
7182024-10-10T04:30:44.538ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7192024-10-10T04:30:44.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7202024-10-10T04:30:44.538ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1052
7212024-10-10T04:30:44.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
7222024-10-10T04:30:44.538ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
7232024-10-10T04:30:44.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
7242024-10-10T04:30:44.539ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7252024-10-10T04:30:44.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7262024-10-10T04:30:44.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7272024-10-10T04:30:44.540ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7282024-10-10T04:30:44.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7292024-10-10T04:30:44.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7302024-10-10T04:30:44.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7312024-10-10T04:30:44.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7322024-10-10T04:30:44.543ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.614531ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
7332024-10-10T04:30:44.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7342024-10-10T04:30:44.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7352024-10-10T04:30:44.544ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-10 04:20:44.532879463 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
7362024-10-10T04:30:44.544ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.641979ms iteration = 6 status = {"expiration":"2024-10-10T04:20:44.532879463Z","pruned":[]}
7372024-10-10T04:30:44.546ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7382024-10-10T04:30:44.548ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7392024-10-10T04:30:44.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7402024-10-10T04:30:44.549ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7412024-10-10T04:30:44.549ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7422024-10-10T04:30:44.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7432024-10-10T04:30:44.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7442024-10-10T04:30:44.552ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 13674, tv_nsec: 145358813 } })
7452024-10-10T04:30:44.553ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7462024-10-10T04:30:44.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7472024-10-10T04:30:44.554ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1052 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a
7482024-10-10T04:30:44.554ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7492024-10-10T04:30:44.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7502024-10-10T04:30:44.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7512024-10-10T04:30:44.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7522024-10-10T04:30:44.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7532024-10-10T04:30:44.587ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7542024-10-10T04:30:44.588ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7552024-10-10T04:30:44.588ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7562024-10-10T04:30:44.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7572024-10-10T04:30:44.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7582024-10-10T04:30:44.589ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7592024-10-10T04:30:44.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7602024-10-10T04:30:44.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7612024-10-10T04:30:44.590ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7622024-10-10T04:30:44.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7632024-10-10T04:30:44.591ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7642024-10-10T04:30:44.591ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7652024-10-10T04:30:44.591ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7662024-10-10T04:30:44.591ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7672024-10-10T04:30:44.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7682024-10-10T04:30:44.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7692024-10-10T04:30:44.591ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7702024-10-10T04:30:44.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7712024-10-10T04:30:44.592ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7722024-10-10T04:30:44.592ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.45017ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7732024-10-10T04:30:44.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7742024-10-10T04:30:44.592ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7752024-10-10T04:30:44.592ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7762024-10-10T04:30:44.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7772024-10-10T04:30:44.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7782024-10-10T04:30:44.593ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7792024-10-10T04:30:44.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7802024-10-10T04:30:44.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7812024-10-10T04:30:44.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7822024-10-10T04:30:44.595ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7832024-10-10T04:30:44.595ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
7842024-10-10T04:30:44.595ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
7852024-10-10T04:30:44.595ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.224006ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
7862024-10-10T04:30:44.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7872024-10-10T04:30:44.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 62.802212ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7882024-10-10T04:30:44.595ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
7892024-10-10T04:30:44.595ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
7902024-10-10T04:30:44.596ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
7912024-10-10T04:30:44.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7922024-10-10T04:30:44.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7932024-10-10T04:30:44.596ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7942024-10-10T04:30:44.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7952024-10-10T04:30:44.596ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7962024-10-10T04:30:44.596ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
7972024-10-10T04:30:44.596ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
7982024-10-10T04:30:44.596ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 64.16472ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7992024-10-10T04:30:44.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8002024-10-10T04:30:44.597ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8012024-10-10T04:30:44.597ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
8022024-10-10T04:30:44.597ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8032024-10-10T04:30:44.597ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8042024-10-10T04:30:44.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8052024-10-10T04:30:44.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8062024-10-10T04:30:44.598ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8072024-10-10T04:30:44.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8082024-10-10T04:30:44.598ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8092024-10-10T04:30:44.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8102024-10-10T04:30:44.598ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8112024-10-10T04:30:44.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8122024-10-10T04:30:44.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8132024-10-10T04:30:44.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8142024-10-10T04:30:44.599ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8152024-10-10T04:30:44.601ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8162024-10-10T04:30:44.601ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8172024-10-10T04:30:44.601ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
8182024-10-10T04:30:44.601ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.454818ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
8192024-10-10T04:30:44.601ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8202024-10-10T04:30:44.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8212024-10-10T04:30:44.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8222024-10-10T04:30:44.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8232024-10-10T04:30:44.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8242024-10-10T04:30:44.603ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8252024-10-10T04:30:44.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8262024-10-10T04:30:44.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1ba4e165-7586-4255-a320-af3c6bf6137c, lookup_type: ById(1ba4e165-7586-4255-a320-af3c6bf6137c) } result = Ok(())
8272024-10-10T04:30:44.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8282024-10-10T04:30:44.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8292024-10-10T04:30:44.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
8302024-10-10T04:30:44.608ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8312024-10-10T04:30:44.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8322024-10-10T04:30:44.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8332024-10-10T04:30:44.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9772f104-f050-4d64-ad07-7e3347035f74, lookup_type: ById(9772f104-f050-4d64-ad07-7e3347035f74) } result = Ok(())
8342024-10-10T04:30:44.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8352024-10-10T04:30:44.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8362024-10-10T04:30:44.615ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 82.912714ms iteration = 11 status = 0
8372024-10-10T04:30:44.621ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c original_time_created = 2024-10-10 04:25:36.941399 UTC target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c time_created = 2024-10-10 04:25:36.941399 UTC
8382024-10-10T04:30:44.621ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.842547ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1ba4e165-7586-4255-a320-af3c6bf6137c","time_created":"2024-10-10T04:25:36.941399Z"}
8392024-10-10T04:30:44.637ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
8402024-10-10T04:30:44.637ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
8412024-10-10T04:30:44.637ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.028861ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
8422024-10-10T04:30:44.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
8432024-10-10T04:30:44.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
8442024-10-10T04:30:44.644ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8452024-10-10T04:30:44.650ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
8462024-10-10T04:30:44.650ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8472024-10-10T04:30:44.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8482024-10-10T04:30:44.655ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
8492024-10-10T04:30:44.655ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
8502024-10-10T04:30:44.655ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
8512024-10-10T04:30:44.655ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8522024-10-10T04:30:44.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8532024-10-10T04:30:44.656ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8542024-10-10T04:30:44.659ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8552024-10-10T04:30:44.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8562024-10-10T04:30:44.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8572024-10-10T04:30:44.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8582024-10-10T04:30:44.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8592024-10-10T04:30:44.661ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
8602024-10-10T04:30:44.662ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
8612024-10-10T04:30:44.662ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = faa1bede-5675-4594-bc5b-032dee6c377c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
8622024-10-10T04:30:44.662ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8632024-10-10T04:30:44.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8642024-10-10T04:30:44.662ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8652024-10-10T04:30:44.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8662024-10-10T04:30:44.663ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
8672024-10-10T04:30:44.664ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8682024-10-10T04:30:44.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8692024-10-10T04:30:44.664ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8702024-10-10T04:30:44.665ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8712024-10-10T04:30:44.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8722024-10-10T04:30:44.668ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8732024-10-10T04:30:44.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8742024-10-10T04:30:44.668ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
8752024-10-10T04:30:44.668ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8762024-10-10T04:30:44.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8772024-10-10T04:30:44.671ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = faa1bede-5675-4594-bc5b-032dee6c377c dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
8782024-10-10T04:30:44.671ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
8792024-10-10T04:30:44.671ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-10 04:25:45.247702 UTC dns_group = internal generation = 1
8802024-10-10T04:30:44.671ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 138.763796ms iteration = 7 status = {"generation":1}
8812024-10-10T04:30:44.673ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1060 zone_address = fd00:1122:3344:101::2
8822024-10-10T04:30:44.673ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8832024-10-10T04:30:44.674ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b01a7ac-aee7-4cac-a3e4-1f254423abca", "content-length": "26", "date": "Thu, 10 Oct 2024 04:30:43 GMT"} })
8842024-10-10T04:30:44.674ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1065 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8852024-10-10T04:30:44.675ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1097 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8862024-10-10T04:30:44.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8872024-10-10T04:30:44.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8882024-10-10T04:30:44.687ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1060 zone_address = fd00:1122:3344:101::2
8892024-10-10T04:30:44.687ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8902024-10-10T04:30:44.688ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f814d69e-7f26-43ff-8205-07b7ed9ee6f6", "content-length": "26", "date": "Thu, 10 Oct 2024 04:30:43 GMT"} })
8912024-10-10T04:30:44.688ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1065 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8922024-10-10T04:30:44.692ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1097 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8932024-10-10T04:30:44.694ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1060 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a zone_address = fd00:1122:3344:101::2
8942024-10-10T04:30:44.694ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8952024-10-10T04:30:44.696ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44bd09af-8ff0-4b98-a1a8-eea739bb9e15", "content-length": "26", "date": "Thu, 10 Oct 2024 04:30:43 GMT"} })
8962024-10-10T04:30:44.696ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1065 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8972024-10-10T04:30:44.698ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1097 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fb9aa554-f959-49d5-975a-a4595288f00a
8982024-10-10T04:30:44.711ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
8992024-10-10T04:30:44.711ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3659471-cbd0-4b22-b439-06b0609b45a5 dns_zone_name = oxide.test found_so_far = 0 version = 2
9002024-10-10T04:30:44.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9012024-10-10T04:30:44.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9022024-10-10T04:30:44.723ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9032024-10-10T04:30:44.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9042024-10-10T04:30:44.728ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9052024-10-10T04:30:44.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9062024-10-10T04:30:44.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9072024-10-10T04:30:44.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9082024-10-10T04:30:44.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9092024-10-10T04:30:44.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9102024-10-10T04:30:44.735ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-10T04:25:42.021839Z, time_modified: 2024-10-10T04:25:42.021839Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, db_silo: Silo { identity: SiloIdentity { id: 1104c51c-4e42-4c05-99d9-0e655da0191e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-10T04:25:46.382172Z, time_modified: 2024-10-10T04:25:46.382172Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "666653ed681e8582d913e07a59566200abc7216bb4bc8c8f89cf34a3eafa830c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, db_silo: Silo { identity: SiloIdentity { id: 1104c51c-4e42-4c05-99d9-0e655da0191e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-10T04:25:46.382172Z, time_modified: 2024-10-10T04:25:46.382172Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "666653ed681e8582d913e07a59566200abc7216bb4bc8c8f89cf34a3eafa830c" }] }) }
9112024-10-10T04:30:44.735ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 202.217828ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1104c51c-4e42-4c05-99d9-0e655da0191e","tls_certs":["666653ed681e8582d913e07a59566200abc7216bb4bc8c8f89cf34a3eafa830c"]}},"default_endpoint":{"silo_id":"1104c51c-4e42-4c05-99d9-0e655da0191e","tls_certs":["666653ed681e8582d913e07a59566200abc7216bb4bc8c8f89cf34a3eafa830c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
9122024-10-10T04:30:44.735ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
9132024-10-10T04:30:44.735ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 203.003789ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
9142024-10-10T04:30:44.742ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 209.188248ms iteration = 13 status = {"physical_disks_added":0}
9152024-10-10T04:30:44.809ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
9162024-10-10T04:30:44.810ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e697f13d-52ba-4fa3-ad19-0ce38919aecb", "date": "Thu, 10 Oct 2024 04:30:43 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9172024-10-10T04:30:44.810ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9182024-10-10T04:30:44.812ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ae215204-3cbf-41ff-b628-47f06e0c2647", "date": "Thu, 10 Oct 2024 04:30:43 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9192024-10-10T04:30:44.812ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9202024-10-10T04:30:44.814ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
9212024-10-10T04:30:44.814ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 281.74321ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
9222024-10-10T04:30:44.840ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
9232024-10-10T04:30:44.849ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
9242024-10-10T04:30:44.849ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e0e2e60-b8fe-49b7-a507-1798afa734d9", "content-length": "2", "date": "Thu, 10 Oct 2024 04:30:44 GMT"} })
9252024-10-10T04:30:44.850ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9262024-10-10T04:30:44.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9272024-10-10T04:30:44.859ZINFOnexus (BackgroundTasks): VPC route manager sled 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
9282024-10-10T04:30:44.859ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9292024-10-10T04:30:44.859ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a04ea292-6189-4f38-b746-1a6706895550", "content-length": "372", "date": "Thu, 10 Oct 2024 04:30:44 GMT"} })
9302024-10-10T04:30:44.859ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9312024-10-10T04:30:44.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9322024-10-10T04:30:44.861ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9332024-10-10T04:30:44.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9342024-10-10T04:30:44.862ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 329.8478ms iteration = 11 status = null
9352024-10-10T04:30:44.862ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9362024-10-10T04:30:44.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9372024-10-10T04:30:44.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
9382024-10-10T04:30:44.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9392024-10-10T04:30:44.864ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9402024-10-10T04:30:44.864ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9412024-10-10T04:30:44.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9422024-10-10T04:30:44.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9432024-10-10T04:30:44.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9442024-10-10T04:30:44.867ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3659471-cbd0-4b22-b439-06b0609b45a5 dns_zone_name = oxide.test found_so_far = 1 version = 2
9452024-10-10T04:30:44.867ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
9462024-10-10T04:30:44.867ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-10 04:25:46.435736 UTC dns_group = external generation = 2
9472024-10-10T04:30:44.867ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 335.30221ms iteration = 7 status = {"generation":2}
9482024-10-10T04:30:44.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9492024-10-10T04:30:44.869ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9502024-10-10T04:30:44.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9512024-10-10T04:30:44.871ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9522024-10-10T04:30:44.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9532024-10-10T04:30:44.901ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9542024-10-10T04:30:44.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9552024-10-10T04:30:44.903ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9562024-10-10T04:30:44.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9572024-10-10T04:30:44.904ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9582024-10-10T04:30:44.907ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
9592024-10-10T04:30:44.907ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9602024-10-10T04:30:44.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9612024-10-10T04:30:44.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9622024-10-10T04:30:44.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9632024-10-10T04:30:44.910ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
9642024-10-10T04:30:44.910ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
9652024-10-10T04:30:44.911ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "38eb6011-6afa-40bb-858d-df554896120d", "date": "Thu, 10 Oct 2024 04:30:44 GMT"} })
9662024-10-10T04:30:44.911ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9672024-10-10T04:30:44.911ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9682024-10-10T04:30:44.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9692024-10-10T04:30:44.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9702024-10-10T04:30:44.913ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9712024-10-10T04:30:44.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9722024-10-10T04:30:44.914ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9732024-10-10T04:30:44.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9742024-10-10T04:30:44.916ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
9752024-10-10T04:30:44.916ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9762024-10-10T04:30:44.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9772024-10-10T04:30:44.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9782024-10-10T04:30:44.918ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9792024-10-10T04:30:44.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9802024-10-10T04:30:44.919ZINFOnexus (BackgroundTasks): VPC route manager sled 9772f104-f050-4d64-ad07-7e3347035f74 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
9812024-10-10T04:30:44.919ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
9822024-10-10T04:30:44.919ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9832024-10-10T04:30:44.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9842024-10-10T04:30:44.920ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ec3925cd-33a4-48fe-8d71-6d8708b5f0d2", "date": "Thu, 10 Oct 2024 04:30:44 GMT"} })
9852024-10-10T04:30:44.920ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9862024-10-10T04:30:44.922ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 389.321172ms iteration = 15 status = {}
9872024-10-10T04:30:44.924ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
9882024-10-10T04:30:44.924ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
9892024-10-10T04:30:44.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
9902024-10-10T04:30:44.935ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 403.174871ms iteration = 11 status = {}
9912024-10-10T04:30:44.941ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
9922024-10-10T04:30:44.942ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d723e0d0-bdde-4c4c-b0ca-6e790297d4c5", "date": "Thu, 10 Oct 2024 04:30:44 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
9932024-10-10T04:30:44.942ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
9942024-10-10T04:30:44.944ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "48fc7ceb-0a07-41eb-977e-9ef7ce226ba4", "date": "Thu, 10 Oct 2024 04:30:43 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
9952024-10-10T04:30:44.944ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
9962024-10-10T04:30:44.946ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e295865c-4c1d-4053-b4e3-334b7e126238", "date": "Thu, 10 Oct 2024 04:30:44 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
9972024-10-10T04:30:44.946ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
9982024-10-10T04:30:44.947ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
9992024-10-10T04:30:44.948ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 415.178222ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
10002024-10-10T04:30:44.991ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
10012024-10-10T04:30:44.992ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c91e5b6b-a579-4817-bdf4-d6b42f237bcd", "content-length": "691", "date": "Thu, 10 Oct 2024 04:30:44 GMT"} })
10022024-10-10T04:30:44.992ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
10032024-10-10T04:30:44.992ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
10042024-10-10T04:30:44.992ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
10052024-10-10T04:30:44.993ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10062024-10-10T04:30:44.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10072024-10-10T04:30:44.993ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 460.506705ms iteration = 13 status = {}
10082024-10-10T04:30:44.994ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10092024-10-10T04:30:44.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10102024-10-10T04:30:44.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10112024-10-10T04:30:44.999ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
10122024-10-10T04:30:44.999ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10132024-10-10T04:30:44.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10142024-10-10T04:30:45.004ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10152024-10-10T04:30:45.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10162024-10-10T04:30:45.006ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10172024-10-10T04:30:45.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10182024-10-10T04:30:45.007ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10192024-10-10T04:30:45.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10202024-10-10T04:30:45.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10212024-10-10T04:30:45.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10222024-10-10T04:30:45.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10232024-10-10T04:30:45.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10242024-10-10T04:30:45.014ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10252024-10-10T04:30:45.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10262024-10-10T04:30:45.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10272024-10-10T04:30:45.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10282024-10-10T04:30:45.017ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10292024-10-10T04:30:45.021ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10302024-10-10T04:30:45.021ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10312024-10-10T04:30:45.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10322024-10-10T04:30:45.023ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10332024-10-10T04:30:45.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10342024-10-10T04:30:45.024ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10352024-10-10T04:30:45.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10362024-10-10T04:30:45.026ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10372024-10-10T04:30:45.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10382024-10-10T04:30:45.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10392024-10-10T04:30:45.028ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ca93cde9-a76e-4d6d-8179-1b6e1a0745b6, rack_id: fb9aa554-f959-49d5-975a-a4595288f00a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2631167f-aa2a-400a-aa67-8033c4a469e6) } rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch_location = Switch0
10402024-10-10T04:30:45.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10412024-10-10T04:30:45.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10422024-10-10T04:30:45.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
10432024-10-10T04:30:45.030ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10442024-10-10T04:30:45.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10452024-10-10T04:30:45.037ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 1829e665-fb89-42b3-9a66-6e40ee21a0b7, kind: Service { id: 6428ed70-db9f-4da8-8d9d-b09c2dd1c036 }, name: Name("nexus-6428ed70-db9f-4da8-8d9d-b09c2dd1c036"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4de71abe-7b12-42f1-b925-fb4c5f7bbb10, kind: Service { id: ae38e123-1a56-4e03-95ec-310ca72bbd8a }, name: Name("nexus-ae38e123-1a56-4e03-95ec-310ca72bbd8a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 210])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8cedea6e-3a64-4551-93ec-6debcab5913e, kind: Service { id: b45736b5-247d-4057-a8d4-ebf2c7559797 }, name: Name("nexus-b45736b5-247d-4057-a8d4-ebf2c7559797"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: a9f3dd40-0511-40d8-a0ba-72083824e3f4, kind: Service { id: 2d31e501-c50e-4f36-b9cb-03903788e2aa }, name: Name("external-dns-2d31e501-c50e-4f36-b9cb-03903788e2aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 128])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b4bed306-af7b-4e06-8da1-513b48153405, kind: Service { id: 33ad8f93-2b4e-4f15-a193-986145855dbb }, name: Name("external-dns-33ad8f93-2b4e-4f15-a193-986145855dbb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 167])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
10462024-10-10T04:30:45.037ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10472024-10-10T04:30:45.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10482024-10-10T04:30:45.039ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10492024-10-10T04:30:45.040ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
10502024-10-10T04:30:45.040ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10512024-10-10T04:30:45.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10522024-10-10T04:30:45.042ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
10532024-10-10T04:30:45.042ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: a9f3dd40-0511-40d8-a0ba-72083824e3f4, kind: Service { id: 2d31e501-c50e-4f36-b9cb-03903788e2aa }, name: Name("external-dns-2d31e501-c50e-4f36-b9cb-03903788e2aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 162, 128])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: b4bed306-af7b-4e06-8da1-513b48153405, kind: Service { id: 33ad8f93-2b4e-4f15-a193-986145855dbb }, name: Name("external-dns-33ad8f93-2b4e-4f15-a193-986145855dbb"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 143, 167])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1829e665-fb89-42b3-9a66-6e40ee21a0b7, kind: Service { id: 6428ed70-db9f-4da8-8d9d-b09c2dd1c036 }, name: Name("nexus-6428ed70-db9f-4da8-8d9d-b09c2dd1c036"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 242, 159])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4de71abe-7b12-42f1-b925-fb4c5f7bbb10, kind: Service { id: ae38e123-1a56-4e03-95ec-310ca72bbd8a }, name: Name("nexus-ae38e123-1a56-4e03-95ec-310ca72bbd8a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 210])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8cedea6e-3a64-4551-93ec-6debcab5913e, kind: Service { id: b45736b5-247d-4057-a8d4-ebf2c7559797 }, name: Name("nexus-b45736b5-247d-4057-a8d4-ebf2c7559797"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 247, 69])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
10542024-10-10T04:30:45.042ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
10552024-10-10T04:30:45.106ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 9772f104-f050-4d64-ad07-7e3347035f74, time_created: 2024-10-10T04:25:43.102025Z, time_modified: 2024-10-10T04:25:43.102025Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: fb9aa554-f959-49d5-975a-a4595288f00a, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
10562024-10-10T04:30:45.106ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
10572024-10-10T04:30:45.106ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10582024-10-10T04:30:45.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10592024-10-10T04:30:45.109ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
10602024-10-10T04:30:45.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
10612024-10-10T04:30:45.111ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10622024-10-10T04:30:45.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 9772f104-f050-4d64-ad07-7e3347035f74, lookup_type: ById(9772f104-f050-4d64-ad07-7e3347035f74) } result = Ok(())
10632024-10-10T04:30:45.143ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
10642024-10-10T04:30:45.143ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "adc6f878-ace0-4329-a421-1a7356e3b792", "date": "Thu, 10 Oct 2024 04:30:44 GMT"} })
10652024-10-10T04:30:45.144ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
10662024-10-10T04:30:45.144ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 611.924749ms
10672024-10-10T04:30:45.144ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 611.9326ms iteration = 2 status = {}
10682024-10-10T04:30:45.217ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
10692024-10-10T04:30:45.217ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f907c7a-4b76-4911-952b-8df1dca7cbff", "content-length": "121", "date": "Thu, 10 Oct 2024 04:30:44 GMT"} })
10702024-10-10T04:30:45.217ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
10712024-10-10T04:30:45.217ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2631167f-aa2a-400a-aa67-8033c4a469e6
10722024-10-10T04:30:45.217ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
10732024-10-10T04:30:45.217ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
10742024-10-10T04:30:45.217ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10752024-10-10T04:30:45.217ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10762024-10-10T04:30:45.217ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10772024-10-10T04:30:45.217ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10782024-10-10T04:30:45.217ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
10792024-10-10T04:30:45.217ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
10802024-10-10T04:30:45.218ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a
10812024-10-10T04:30:45.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10822024-10-10T04:30:45.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10832024-10-10T04:30:45.220ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
10842024-10-10T04:30:45.220ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b53307a4-f54b-4a4d-b7a7-d0ab55f5d646", "content-length": "2", "date": "Thu, 10 Oct 2024 04:30:44 GMT"} })
10852024-10-10T04:30:45.220ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
10862024-10-10T04:30:45.220ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d03e0afc-122f-4bd7-a536-fe59d9b2f1c1", "content-length": "52", "date": "Thu, 10 Oct 2024 04:30:44 GMT"} })
10872024-10-10T04:30:45.220ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch_location = Switch0
10882024-10-10T04:30:45.220ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
10892024-10-10T04:30:45.314ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8a6b8cf7-359c-4cc1-9434-41dba05c081c", "date": "Thu, 10 Oct 2024 04:30:45 GMT"} })
10902024-10-10T04:30:45.314ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch = Switch0
10912024-10-10T04:30:45.314ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
10922024-10-10T04:30:45.315ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "137c0518-c719-4bc5-9ed1-c06c3e8c5206", "content-length": "669", "date": "Thu, 10 Oct 2024 04:30:45 GMT"} })
10932024-10-10T04:30:45.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10942024-10-10T04:30:45.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10952024-10-10T04:30:45.319ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10962024-10-10T04:30:45.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10972024-10-10T04:30:45.323ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10982024-10-10T04:30:45.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10992024-10-10T04:30:45.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11002024-10-10T04:30:45.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11012024-10-10T04:30:45.332ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 799.528567ms iteration = 11 status = {}
11022024-10-10T04:30:47.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2217 local_addr = [fd00:1122:3344:101::a]:52536 method = GET remote_addr = [fd00:1122:3344:101::d]:49035 req_id = a68e9e73-ac36-4c99-9415-151eac6a6287 response_code = 200 uri = /6428ed70-db9f-4da8-8d9d-b09c2dd1c036
11032024-10-10T04:30:47.763ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
11042024-10-10T04:30:47.763ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
11052024-10-10T04:30:47.793ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
11062024-10-10T04:30:47.793ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:48035
11072024-10-10T04:30:47.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:48035 req_id = 78dde7c8-d9c5-4f2a-aa87-3e75de7ed75a roles = RoleSet { roles: {} } uri = /metrics/producers
11082024-10-10T04:30:47.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:48035 req_id = 78dde7c8-d9c5-4f2a-aa87-3e75de7ed75a resource = Database result = Ok(()) uri = /metrics/producers
11092024-10-10T04:30:47.860ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = 79488ebd-ca89-4737-be0d-354826998905
11102024-10-10T04:30:47.860ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 79488ebd-ca89-4737-be0d-354826998905 uri = http://[fd00:1122:3344:101::d]:12223/producers
11112024-10-10T04:30:47.861ZDEBGnexus: client response oximeter-collector = 79488ebd-ca89-4737-be0d-354826998905 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "f22fbd87-87fb-4aa3-ba6b-c26cbfb6947b", "date": "Thu, 10 Oct 2024 04:30:47 GMT"} })
11122024-10-10T04:30:47.861ZINFOnexus: assigned collector to new producer collector_id = 79488ebd-ca89-4737-be0d-354826998905 file = nexus/src/app/oximeter.rs:133 producer_id = 6428ed70-db9f-4da8-8d9d-b09c2dd1c036
11132024-10-10T04:30:47.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67725 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:48035 req_id = 78dde7c8-d9c5-4f2a-aa87-3e75de7ed75a response_code = 201 uri = /metrics/producers
11142024-10-10T04:30:47.861ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "78dde7c8-d9c5-4f2a-aa87-3e75de7ed75a", "content-length": "41", "date": "Thu, 10 Oct 2024 04:30:47 GMT"} })
11152024-10-10T04:30:47.862ZDEBGnexus (producer-registration-task): registered with nexus successfully
11162024-10-10T04:30:47.862ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
11172024-10-10T04:30:52.209ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:44180
11182024-10-10T04:30:52.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44180 req_id = 5aa37375-9494-4d06-ac87-e4e2d9645089 roles = RoleSet { roles: {} } uri = /metrics/producers
11192024-10-10T04:30:52.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44180 req_id = 5aa37375-9494-4d06-ac87-e4e2d9645089 resource = Database result = Ok(()) uri = /metrics/producers
11202024-10-10T04:30:52.280ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = 79488ebd-ca89-4737-be0d-354826998905
11212024-10-10T04:30:52.280ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 79488ebd-ca89-4737-be0d-354826998905 uri = http://[fd00:1122:3344:101::d]:12223/producers
11222024-10-10T04:30:52.280ZDEBGnexus: client response oximeter-collector = 79488ebd-ca89-4737-be0d-354826998905 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "0c5dc7f2-01dd-45b5-82c2-18f37043891e", "date": "Thu, 10 Oct 2024 04:30:52 GMT"} })
11232024-10-10T04:30:52.280ZINFOnexus: assigned collector to new producer collector_id = 79488ebd-ca89-4737-be0d-354826998905 file = nexus/src/app/oximeter.rs:133 producer_id = 2870eb15-9dd5-4ed8-9301-c37142447e0b
11242024-10-10T04:30:52.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 73896 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44180 req_id = 5aa37375-9494-4d06-ac87-e4e2d9645089 response_code = 201 uri = /metrics/producers
11252024-10-10T04:30:54.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
11262024-10-10T04:30:54.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
11272024-10-10T04:30:54.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11282024-10-10T04:30:54.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11292024-10-10T04:30:54.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11302024-10-10T04:30:54.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11312024-10-10T04:30:54.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11322024-10-10T04:30:54.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11332024-10-10T04:30:54.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11342024-10-10T04:30:54.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11352024-10-10T04:30:54.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11362024-10-10T04:30:54.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11372024-10-10T04:30:54.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11382024-10-10T04:30:54.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1ba4e165-7586-4255-a320-af3c6bf6137c, lookup_type: ById(1ba4e165-7586-4255-a320-af3c6bf6137c) } result = Ok(())
11392024-10-10T04:30:54.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11402024-10-10T04:30:54.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11412024-10-10T04:30:54.555ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c original_time_created = 2024-10-10 04:25:36.941399 UTC target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c time_created = 2024-10-10 04:25:36.941399 UTC
11422024-10-10T04:30:54.555ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.25095ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1ba4e165-7586-4255-a320-af3c6bf6137c","time_created":"2024-10-10T04:25:36.941399Z"}
11432024-10-10T04:30:54.562ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11442024-10-10T04:30:54.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11452024-10-10T04:30:54.589ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.760477ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11462024-10-10T04:30:57.864ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2719 local_addr = [fd00:1122:3344:101::a]:52536 method = GET remote_addr = [fd00:1122:3344:101::d]:49035 req_id = ee552934-0f6e-4def-9000-6bfba385576e response_code = 200 uri = /6428ed70-db9f-4da8-8d9d-b09c2dd1c036
11472024-10-10T04:30:57.956ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::1]:59436
11482024-10-10T04:30:57.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59436 req_id = d5eb8d71-a8ce-4dca-9584-48550d6ea466 roles = RoleSet { roles: {} } uri = /metrics/producers
11492024-10-10T04:30:57.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59436 req_id = d5eb8d71-a8ce-4dca-9584-48550d6ea466 resource = Database result = Ok(()) uri = /metrics/producers
11502024-10-10T04:30:58.027ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = 79488ebd-ca89-4737-be0d-354826998905
11512024-10-10T04:30:58.027ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 79488ebd-ca89-4737-be0d-354826998905 uri = http://[fd00:1122:3344:101::d]:12223/producers
11522024-10-10T04:30:58.027ZDEBGnexus: client response oximeter-collector = 79488ebd-ca89-4737-be0d-354826998905 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "2b411a85-b073-46ba-860c-4c2b89d84ce1", "date": "Thu, 10 Oct 2024 04:30:58 GMT"} })
11532024-10-10T04:30:58.027ZINFOnexus: assigned collector to new producer collector_id = 79488ebd-ca89-4737-be0d-354826998905 file = nexus/src/app/oximeter.rs:133 producer_id = d47bc5f8-9dcb-4e26-8197-93be500c1717
11542024-10-10T04:30:58.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 72143 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:59436 req_id = d5eb8d71-a8ce-4dca-9584-48550d6ea466 response_code = 201 uri = /metrics/producers
11552024-10-10T04:30:58.332ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:35430
11562024-10-10T04:30:58.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35430 req_id = 2ac71baf-3f02-411c-a7de-816d6917cae7 roles = RoleSet { roles: {} } uri = /metrics/producers
11572024-10-10T04:30:58.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35430 req_id = 2ac71baf-3f02-411c-a7de-816d6917cae7 resource = Database result = Ok(()) uri = /metrics/producers
11582024-10-10T04:30:58.402ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = 79488ebd-ca89-4737-be0d-354826998905
11592024-10-10T04:30:58.402ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 79488ebd-ca89-4737-be0d-354826998905 uri = http://[fd00:1122:3344:101::d]:12223/producers
11602024-10-10T04:30:58.402ZDEBGnexus: client response oximeter-collector = 79488ebd-ca89-4737-be0d-354826998905 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "c4bb9c3e-638a-4d55-91d3-a2effa80cb01", "date": "Thu, 10 Oct 2024 04:30:58 GMT"} })
11612024-10-10T04:30:58.402ZINFOnexus: assigned collector to new producer collector_id = 79488ebd-ca89-4737-be0d-354826998905 file = nexus/src/app/oximeter.rs:133 producer_id = 88131f5f-c9b9-4cc9-8bbe-ed172c1318ff
11622024-10-10T04:30:58.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 71199 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35430 req_id = 2ac71baf-3f02-411c-a7de-816d6917cae7 response_code = 201 uri = /metrics/producers
11632024-10-10T04:31:00.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41151 req_id = a0546173-2156-4c6d-9f1e-4a3239af529a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/13?limit=100
11642024-10-10T04:31:00.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41151 req_id = a0546173-2156-4c6d-9f1e-4a3239af529a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/13?limit=100
11652024-10-10T04:31:00.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 19300 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41151 req_id = a0546173-2156-4c6d-9f1e-4a3239af529a response_code = 200 uri = /nat/ipv4/changeset/13?limit=100
11662024-10-10T04:31:00.438ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:36596
11672024-10-10T04:31:00.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36596 req_id = cdeda37e-4b64-4bcd-a843-2c0066c2dad1 roles = RoleSet { roles: {} } uri = /metrics/producers
11682024-10-10T04:31:00.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36596 req_id = cdeda37e-4b64-4bcd-a843-2c0066c2dad1 resource = Database result = Ok(()) uri = /metrics/producers
11692024-10-10T04:31:00.491ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = 79488ebd-ca89-4737-be0d-354826998905
11702024-10-10T04:31:00.491ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 79488ebd-ca89-4737-be0d-354826998905 uri = http://[fd00:1122:3344:101::d]:12223/producers
11712024-10-10T04:31:00.491ZDEBGnexus: client response oximeter-collector = 79488ebd-ca89-4737-be0d-354826998905 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "9f28aa59-35b4-461f-ac21-4752d0bb388c", "date": "Thu, 10 Oct 2024 04:31:00 GMT"} })
11722024-10-10T04:31:00.491ZINFOnexus: assigned collector to new producer collector_id = 79488ebd-ca89-4737-be0d-354826998905 file = nexus/src/app/oximeter.rs:133 producer_id = f12b0ce5-e2e7-42de-bb5e-86f1a975abe0
11732024-10-10T04:31:00.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 53372 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36596 req_id = cdeda37e-4b64-4bcd-a843-2c0066c2dad1 response_code = 201 uri = /metrics/producers
11742024-10-10T04:31:04.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
11752024-10-10T04:31:04.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11762024-10-10T04:31:04.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
11772024-10-10T04:31:04.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11782024-10-10T04:31:04.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11792024-10-10T04:31:04.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11802024-10-10T04:31:04.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11812024-10-10T04:31:04.537ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11822024-10-10T04:31:04.537ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11832024-10-10T04:31:04.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11842024-10-10T04:31:04.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11852024-10-10T04:31:04.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11862024-10-10T04:31:04.543ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11872024-10-10T04:31:04.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1ba4e165-7586-4255-a320-af3c6bf6137c, lookup_type: ById(1ba4e165-7586-4255-a320-af3c6bf6137c) } result = Ok(())
11882024-10-10T04:31:04.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11892024-10-10T04:31:04.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11902024-10-10T04:31:04.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c original_time_created = 2024-10-10 04:25:36.941399 UTC target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c time_created = 2024-10-10 04:25:36.941399 UTC
11912024-10-10T04:31:04.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.647334ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1ba4e165-7586-4255-a320-af3c6bf6137c","time_created":"2024-10-10T04:25:36.941399Z"}
11922024-10-10T04:31:04.566ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11932024-10-10T04:31:04.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11942024-10-10T04:31:04.568ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.293758ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11952024-10-10T04:31:07.864ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2302 local_addr = [fd00:1122:3344:101::a]:52536 method = GET remote_addr = [fd00:1122:3344:101::d]:49035 req_id = dd66a110-3043-46d8-ad21-b655cf8bb636 response_code = 200 uri = /6428ed70-db9f-4da8-8d9d-b09c2dd1c036
11962024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
11972024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
11982024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
11992024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
12002024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12012024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.69\u{b5}s iteration = 12 status = {"errors":[],"records_set_to_done":[]}
12022024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
12032024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
12042024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12052024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
12062024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
12072024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12082024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
12092024-10-10T04:31:14.533ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
12102024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
12112024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12122024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12132024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12142024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
12152024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.411\u{b5}s iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
12162024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
12172024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
12182024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.11\u{b5}s iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
12192024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.22\u{b5}s iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
12202024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
12212024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
12222024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
12232024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12242024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12252024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
12262024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
12272024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12282024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12292024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
12302024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12312024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
12322024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12332024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12342024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12352024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12362024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12372024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12382024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12392024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12402024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12412024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12422024-10-10T04:31:14.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12432024-10-10T04:31:14.536ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12442024-10-10T04:31:14.536ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.146196ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
12452024-10-10T04:31:14.536ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 13704, tv_nsec: 128888871 } })
12462024-10-10T04:31:14.536ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1052
12472024-10-10T04:31:14.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12482024-10-10T04:31:14.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12492024-10-10T04:31:14.538ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 13704, tv_nsec: 130649580 } })
12502024-10-10T04:31:14.538ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1052
12512024-10-10T04:31:14.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12522024-10-10T04:31:14.539ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12532024-10-10T04:31:14.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12542024-10-10T04:31:14.539ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12552024-10-10T04:31:14.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12562024-10-10T04:31:14.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12572024-10-10T04:31:14.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
12582024-10-10T04:31:14.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12592024-10-10T04:31:14.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12602024-10-10T04:31:14.541ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12612024-10-10T04:31:14.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12622024-10-10T04:31:14.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
12632024-10-10T04:31:14.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12642024-10-10T04:31:14.543ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
12652024-10-10T04:31:14.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
12662024-10-10T04:31:14.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12672024-10-10T04:31:14.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
12682024-10-10T04:31:14.548ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 13704, tv_nsec: 141471677 } })
12692024-10-10T04:31:14.549ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1052 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a
12702024-10-10T04:31:14.549ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12712024-10-10T04:31:14.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12722024-10-10T04:31:14.552ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
12732024-10-10T04:31:14.552ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.092704ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
12742024-10-10T04:31:14.552ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12752024-10-10T04:31:14.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12762024-10-10T04:31:14.554ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12772024-10-10T04:31:14.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1ba4e165-7586-4255-a320-af3c6bf6137c, lookup_type: ById(1ba4e165-7586-4255-a320-af3c6bf6137c) } result = Ok(())
12782024-10-10T04:31:14.556ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12792024-10-10T04:31:14.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12802024-10-10T04:31:14.563ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c original_time_created = 2024-10-10 04:25:36.941399 UTC target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c time_created = 2024-10-10 04:25:36.941399 UTC
12812024-10-10T04:31:14.563ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 30.877717ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1ba4e165-7586-4255-a320-af3c6bf6137c","time_created":"2024-10-10T04:25:36.941399Z"}
12822024-10-10T04:31:14.570ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12832024-10-10T04:31:14.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12842024-10-10T04:31:14.572ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12852024-10-10T04:31:14.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12862024-10-10T04:31:14.574ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12872024-10-10T04:31:14.575ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12882024-10-10T04:31:14.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12892024-10-10T04:31:14.576ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
12902024-10-10T04:31:14.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12912024-10-10T04:31:14.576ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12922024-10-10T04:31:14.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12932024-10-10T04:31:14.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
12942024-10-10T04:31:14.576ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 43.464862ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12952024-10-10T04:31:14.577ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 44.765477ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
12962024-10-10T04:31:14.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12972024-10-10T04:31:14.579ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12982024-10-10T04:31:14.579ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
12992024-10-10T04:31:14.579ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13002024-10-10T04:31:14.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13012024-10-10T04:31:14.579ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13022024-10-10T04:31:14.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13032024-10-10T04:31:14.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
13042024-10-10T04:31:14.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13052024-10-10T04:31:14.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13062024-10-10T04:31:14.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13072024-10-10T04:31:14.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13082024-10-10T04:31:14.602ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13092024-10-10T04:31:14.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9772f104-f050-4d64-ad07-7e3347035f74, lookup_type: ById(9772f104-f050-4d64-ad07-7e3347035f74) } result = Ok(())
13102024-10-10T04:31:14.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13112024-10-10T04:31:14.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
13122024-10-10T04:31:14.606ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13132024-10-10T04:31:14.606ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
13142024-10-10T04:31:14.606ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13152024-10-10T04:31:14.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
13162024-10-10T04:31:14.606ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 73.563637ms iteration = 12 status = 0
13172024-10-10T04:31:14.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13182024-10-10T04:31:14.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
13192024-10-10T04:31:14.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13202024-10-10T04:31:14.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
13212024-10-10T04:31:14.615ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 82.343479ms iteration = 14 status = {"physical_disks_added":0}
13222024-10-10T04:31:14.631ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1060 zone_address = fd00:1122:3344:101::2
13232024-10-10T04:31:14.631ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13242024-10-10T04:31:14.631ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fe07112-7f56-40c3-a888-d018ff1a07e3", "content-length": "26", "date": "Thu, 10 Oct 2024 04:31:13 GMT"} })
13252024-10-10T04:31:14.631ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1065 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13262024-10-10T04:31:14.633ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1097 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13272024-10-10T04:31:14.633ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1060 zone_address = fd00:1122:3344:101::2
13282024-10-10T04:31:14.633ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13292024-10-10T04:31:14.635ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6b57a78-1f04-4ce0-9a4a-7772693311ba", "content-length": "26", "date": "Thu, 10 Oct 2024 04:31:13 GMT"} })
13302024-10-10T04:31:14.635ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1065 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13312024-10-10T04:31:14.636ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1097 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
13322024-10-10T04:31:14.644ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1060 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a zone_address = fd00:1122:3344:101::2
13332024-10-10T04:31:14.644ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
13342024-10-10T04:31:14.645ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "62053617-3671-4f4c-8d73-47538150cef5", "content-length": "26", "date": "Thu, 10 Oct 2024 04:31:13 GMT"} })
13352024-10-10T04:31:14.645ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1065 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
13362024-10-10T04:31:14.646ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1097 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fb9aa554-f959-49d5-975a-a4595288f00a
13372024-10-10T04:31:14.649ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
13382024-10-10T04:31:14.649ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
13392024-10-10T04:31:14.649ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 116.097095ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
13402024-10-10T04:31:14.692ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13412024-10-10T04:31:14.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13422024-10-10T04:31:14.694ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13432024-10-10T04:31:14.695ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13442024-10-10T04:31:14.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13452024-10-10T04:31:14.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13462024-10-10T04:31:14.717ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
13472024-10-10T04:31:14.718ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9508231-8c9c-43c6-ad91-ed838c4d0be7", "content-length": "2", "date": "Thu, 10 Oct 2024 04:31:14 GMT"} })
13482024-10-10T04:31:14.719ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13492024-10-10T04:31:14.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
13502024-10-10T04:31:14.746ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 213.129947ms iteration = 12 status = {}
13512024-10-10T04:31:14.746ZINFOnexus (BackgroundTasks): VPC route manager sled 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
13522024-10-10T04:31:14.746ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13532024-10-10T04:31:14.747ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9765ce10-66e8-4f57-adfd-e52313b946f7", "content-length": "372", "date": "Thu, 10 Oct 2024 04:31:14 GMT"} })
13542024-10-10T04:31:14.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13552024-10-10T04:31:14.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13562024-10-10T04:31:14.748ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13572024-10-10T04:31:14.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
13582024-10-10T04:31:14.749ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13592024-10-10T04:31:14.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
13602024-10-10T04:31:14.751ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 218.142245ms iteration = 12 status = null
13612024-10-10T04:31:14.767ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
13622024-10-10T04:31:14.767ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
13632024-10-10T04:31:14.768ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dba1bc4d-b1da-4723-9055-6a4826623320", "date": "Thu, 10 Oct 2024 04:31:14 GMT"} })
13642024-10-10T04:31:14.768ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13652024-10-10T04:31:14.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13662024-10-10T04:31:14.770ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13672024-10-10T04:31:14.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13682024-10-10T04:31:14.773ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13692024-10-10T04:31:14.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
13702024-10-10T04:31:14.818ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
13712024-10-10T04:31:14.819ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e1225d9-e278-4701-8ff9-4ff8ba8a6649", "content-length": "691", "date": "Thu, 10 Oct 2024 04:31:14 GMT"} })
13722024-10-10T04:31:14.819ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
13732024-10-10T04:31:14.819ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
13742024-10-10T04:31:14.819ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
13752024-10-10T04:31:14.820ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 287.762315ms iteration = 14 status = {}
13762024-10-10T04:31:14.822ZINFOnexus (BackgroundTasks): VPC route manager sled 9772f104-f050-4d64-ad07-7e3347035f74 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
13772024-10-10T04:31:14.822ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
13782024-10-10T04:31:14.822ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0fcc2a45-ce28-40d3-b33c-e420459acaa4", "date": "Thu, 10 Oct 2024 04:31:14 GMT"} })
13792024-10-10T04:31:14.824ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 291.372354ms iteration = 16 status = {}
13802024-10-10T04:31:14.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13812024-10-10T04:31:14.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13822024-10-10T04:31:14.844ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ca93cde9-a76e-4d6d-8179-1b6e1a0745b6, rack_id: fb9aa554-f959-49d5-975a-a4595288f00a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2631167f-aa2a-400a-aa67-8033c4a469e6) } rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch_location = Switch0
13832024-10-10T04:31:14.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13842024-10-10T04:31:14.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13852024-10-10T04:31:14.851ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13862024-10-10T04:31:14.851ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffaa8058-c942-4bd3-8d3f-fa62d0ee1ea4", "content-length": "121", "date": "Thu, 10 Oct 2024 04:31:14 GMT"} })
13872024-10-10T04:31:14.851ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
13882024-10-10T04:31:14.851ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2631167f-aa2a-400a-aa67-8033c4a469e6
13892024-10-10T04:31:14.851ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
13902024-10-10T04:31:14.852ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13912024-10-10T04:31:14.852ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13922024-10-10T04:31:14.852ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13932024-10-10T04:31:14.852ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13942024-10-10T04:31:14.852ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13952024-10-10T04:31:14.852ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
13962024-10-10T04:31:14.852ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
13972024-10-10T04:31:14.852ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a
13982024-10-10T04:31:14.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13992024-10-10T04:31:14.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14002024-10-10T04:31:14.854ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
14012024-10-10T04:31:14.854ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "50bea785-35ae-4f83-b562-01a74d62f4c4", "content-length": "2", "date": "Thu, 10 Oct 2024 04:31:14 GMT"} })
14022024-10-10T04:31:14.854ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
14032024-10-10T04:31:14.854ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfc8f86b-9f2f-4709-8e59-b88ab9a8c1a7", "content-length": "52", "date": "Thu, 10 Oct 2024 04:31:14 GMT"} })
14042024-10-10T04:31:14.854ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch_location = Switch0
14052024-10-10T04:31:14.854ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
14062024-10-10T04:31:14.947ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "76c9ccdf-dcc0-4762-ba2e-7b9457d08664", "date": "Thu, 10 Oct 2024 04:31:14 GMT"} })
14072024-10-10T04:31:14.947ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch = Switch0
14082024-10-10T04:31:14.947ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
14092024-10-10T04:31:14.948ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7daddbe-3b74-49ce-a14d-627f32c955c1", "content-length": "669", "date": "Thu, 10 Oct 2024 04:31:14 GMT"} })
14102024-10-10T04:31:14.948ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14112024-10-10T04:31:14.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14122024-10-10T04:31:14.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14132024-10-10T04:31:14.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14142024-10-10T04:31:14.955ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14152024-10-10T04:31:14.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14162024-10-10T04:31:14.958ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14172024-10-10T04:31:14.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14182024-10-10T04:31:14.965ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 432.561408ms iteration = 12 status = {}
14192024-10-10T04:31:17.864ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2128 local_addr = [fd00:1122:3344:101::a]:52536 method = GET remote_addr = [fd00:1122:3344:101::d]:49035 req_id = f86ec172-76c2-4f56-816a-4a5b0983abf9 response_code = 200 uri = /6428ed70-db9f-4da8-8d9d-b09c2dd1c036
14202024-10-10T04:31:19.295ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::1]:51347
14212024-10-10T04:31:19.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51347 req_id = 16a175ff-76b8-42a6-936b-93d74c2324b6 roles = RoleSet { roles: {} } uri = /metrics/producers
14222024-10-10T04:31:19.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51347 req_id = 16a175ff-76b8-42a6-936b-93d74c2324b6 resource = Database result = Ok(()) uri = /metrics/producers
14232024-10-10T04:31:19.363ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = 79488ebd-ca89-4737-be0d-354826998905
14242024-10-10T04:31:19.363ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 79488ebd-ca89-4737-be0d-354826998905 uri = http://[fd00:1122:3344:101::d]:12223/producers
14252024-10-10T04:31:19.363ZDEBGnexus: client response oximeter-collector = 79488ebd-ca89-4737-be0d-354826998905 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "66e0b9cb-d022-459e-8de1-a07ef666b98e", "date": "Thu, 10 Oct 2024 04:31:19 GMT"} })
14262024-10-10T04:31:19.363ZINFOnexus: assigned collector to new producer collector_id = 79488ebd-ca89-4737-be0d-354826998905 file = nexus/src/app/oximeter.rs:133 producer_id = 9772f104-f050-4d64-ad07-7e3347035f74
14272024-10-10T04:31:19.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 69089 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:51347 req_id = 16a175ff-76b8-42a6-936b-93d74c2324b6 response_code = 201 uri = /metrics/producers
14282024-10-10T04:31:24.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
14292024-10-10T04:31:24.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
14302024-10-10T04:31:24.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14312024-10-10T04:31:24.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14322024-10-10T04:31:24.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14332024-10-10T04:31:24.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14342024-10-10T04:31:24.567ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14352024-10-10T04:31:24.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14362024-10-10T04:31:24.568ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14372024-10-10T04:31:24.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14382024-10-10T04:31:24.570ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14392024-10-10T04:31:24.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14402024-10-10T04:31:24.572ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14412024-10-10T04:31:24.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14422024-10-10T04:31:24.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14432024-10-10T04:31:24.576ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1ba4e165-7586-4255-a320-af3c6bf6137c, lookup_type: ById(1ba4e165-7586-4255-a320-af3c6bf6137c) } result = Ok(())
14442024-10-10T04:31:24.576ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14452024-10-10T04:31:24.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14462024-10-10T04:31:24.584ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c original_time_created = 2024-10-10 04:25:36.941399 UTC target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c time_created = 2024-10-10 04:25:36.941399 UTC
14472024-10-10T04:31:24.584ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.053208ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1ba4e165-7586-4255-a320-af3c6bf6137c","time_created":"2024-10-10T04:25:36.941399Z"}
14482024-10-10T04:31:24.595ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.989538ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14492024-10-10T04:31:27.864ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2920 local_addr = [fd00:1122:3344:101::a]:52536 method = GET remote_addr = [fd00:1122:3344:101::d]:49035 req_id = eeca8cb3-93d6-48ad-9316-46db53e8b87f response_code = 200 uri = /6428ed70-db9f-4da8-8d9d-b09c2dd1c036
14502024-10-10T04:31:30.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41151 req_id = 886e0b12-5908-4f7c-b075-a13d93c78eef roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/13?limit=100
14512024-10-10T04:31:30.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41151 req_id = 886e0b12-5908-4f7c-b075-a13d93c78eef resource = Database result = Ok(()) uri = /nat/ipv4/changeset/13?limit=100
14522024-10-10T04:31:30.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2902 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41151 req_id = 886e0b12-5908-4f7c-b075-a13d93c78eef response_code = 200 uri = /nat/ipv4/changeset/13?limit=100
14532024-10-10T04:31:34.532ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
14542024-10-10T04:31:34.532ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
14552024-10-10T04:31:34.532ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14562024-10-10T04:31:34.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14572024-10-10T04:31:34.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14582024-10-10T04:31:34.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14592024-10-10T04:31:34.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14602024-10-10T04:31:34.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14612024-10-10T04:31:34.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14622024-10-10T04:31:34.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14632024-10-10T04:31:34.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14642024-10-10T04:31:34.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14652024-10-10T04:31:34.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14662024-10-10T04:31:34.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14672024-10-10T04:31:34.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14682024-10-10T04:31:34.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1ba4e165-7586-4255-a320-af3c6bf6137c, lookup_type: ById(1ba4e165-7586-4255-a320-af3c6bf6137c) } result = Ok(())
14692024-10-10T04:31:34.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14702024-10-10T04:31:34.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14712024-10-10T04:31:34.554ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c original_time_created = 2024-10-10 04:25:36.941399 UTC target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c time_created = 2024-10-10 04:25:36.941399 UTC
14722024-10-10T04:31:34.554ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.612173ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1ba4e165-7586-4255-a320-af3c6bf6137c","time_created":"2024-10-10T04:25:36.941399Z"}
14732024-10-10T04:31:34.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.572737ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14742024-10-10T04:31:37.864ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2964 local_addr = [fd00:1122:3344:101::a]:52536 method = GET remote_addr = [fd00:1122:3344:101::d]:49035 req_id = 86433ad3-b4b9-462d-9f37-1c9f90fb92c5 response_code = 200 uri = /6428ed70-db9f-4da8-8d9d-b09c2dd1c036
14752024-10-10T04:31:44.532ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
14762024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
14772024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14782024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.55\u{b5}s iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
14792024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
14802024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
14812024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14822024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
14832024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14842024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14852024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14862024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
14872024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14882024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
14892024-10-10T04:31:44.533ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-10-10 04:21:44.533016546 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
14902024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
14912024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
14922024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14932024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
14942024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
14952024-10-10T04:31:44.533ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14962024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
14972024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
14982024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
14992024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15002024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15012024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
15022024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
15032024-10-10T04:31:44.533ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c
15042024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15052024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.94\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"1ba4e165-7586-4255-a320-af3c6bf6137c"}
15062024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
15072024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
15082024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
15092024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.6\u{b5}s iteration = 13 status = {"errors":[],"records_set_to_done":[]}
15102024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
15112024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
15122024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
15132024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15142024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
15152024-10-10T04:31:44.533ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15162024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
15172024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15182024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15192024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
15202024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
15212024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
15222024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 11.69\u{b5}s iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
15232024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
15242024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15252024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
15262024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
15272024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15282024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15292024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
15302024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
15312024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15322024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
15332024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
15342024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15352024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
15362024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
15372024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.83\u{b5}s iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
15382024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15392024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15402024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15412024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15422024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15432024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15442024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15452024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15462024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15472024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15482024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15492024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15502024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
15512024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
15522024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
15532024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15542024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15552024-10-10T04:31:44.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15562024-10-10T04:31:44.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15572024-10-10T04:31:44.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15582024-10-10T04:31:44.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15592024-10-10T04:31:44.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15602024-10-10T04:31:44.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15612024-10-10T04:31:44.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15622024-10-10T04:31:44.534ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("2d31e501-c50e-4f36-b9cb-03903788e2aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("33ad8f93-2b4e-4f15-a193-986145855dbb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("33ad8f93-2b4e-4f15-a193-986145855dbb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 13734, tv_nsec: 126916247 } })
15632024-10-10T04:31:44.534ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6e4b104b-3153-4ae2-b17a-59d4ed30a709.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("95221550-ad50-418f-98e6-9e2141b25707.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("9cad939d-13f3-4335-926c-49857d4c3b0f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("9cad939d-13f3-4335-926c-49857d4c3b0f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 13734, tv_nsec: 126945068 } })
15642024-10-10T04:31:44.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15652024-10-10T04:31:44.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15662024-10-10T04:31:44.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15672024-10-10T04:31:44.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15682024-10-10T04:31:44.534ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15692024-10-10T04:31:44.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15702024-10-10T04:31:44.535ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
15712024-10-10T04:31:44.535ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.688614ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
15722024-10-10T04:31:44.535ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
15732024-10-10T04:31:44.535ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.645482ms iteration = 8 status = {"addresses":["[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353"]}
15742024-10-10T04:31:44.536ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
15752024-10-10T04:31:44.536ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15762024-10-10T04:31:44.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15772024-10-10T04:31:44.538ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.75075ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15782024-10-10T04:31:44.538ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15792024-10-10T04:31:44.539ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15802024-10-10T04:31:44.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15812024-10-10T04:31:44.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15822024-10-10T04:31:44.540ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15832024-10-10T04:31:44.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15842024-10-10T04:31:44.540ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15852024-10-10T04:31:44.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15862024-10-10T04:31:44.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15872024-10-10T04:31:44.542ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 13734, tv_nsec: 135189394 } })
15882024-10-10T04:31:44.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15892024-10-10T04:31:44.543ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1052
15902024-10-10T04:31:44.544ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-10-10 04:21:44.533016546 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
15912024-10-10T04:31:44.544ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.013593ms iteration = 7 status = {"expiration":"2024-10-10T04:21:44.533016546Z","pruned":[]}
15922024-10-10T04:31:44.544ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.691801ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
15932024-10-10T04:31:44.545ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15942024-10-10T04:31:44.545ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15952024-10-10T04:31:44.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15962024-10-10T04:31:44.547ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15972024-10-10T04:31:44.548ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15982024-10-10T04:31:44.549ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 13734, tv_nsec: 142112334 } })
15992024-10-10T04:31:44.550ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1052
16002024-10-10T04:31:44.550ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
16012024-10-10T04:31:44.550ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16022024-10-10T04:31:44.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16032024-10-10T04:31:44.551ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16042024-10-10T04:31:44.551ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16052024-10-10T04:31:44.551ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16062024-10-10T04:31:44.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16072024-10-10T04:31:44.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16082024-10-10T04:31:44.553ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16092024-10-10T04:31:44.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16102024-10-10T04:31:44.555ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16112024-10-10T04:31:44.555ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16122024-10-10T04:31:44.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16132024-10-10T04:31:44.557ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-9772f104-f050-4d64-ad07-7e3347035f74.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 13734, tv_nsec: 150088843 } })
16142024-10-10T04:31:44.557ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1052 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a
16152024-10-10T04:31:44.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16162024-10-10T04:31:44.560ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16172024-10-10T04:31:44.560ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16182024-10-10T04:31:44.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16192024-10-10T04:31:44.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16202024-10-10T04:31:44.564ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16212024-10-10T04:31:44.566ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1ba4e165-7586-4255-a320-af3c6bf6137c, lookup_type: ById(1ba4e165-7586-4255-a320-af3c6bf6137c) } result = Ok(())
16222024-10-10T04:31:44.566ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16232024-10-10T04:31:44.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16242024-10-10T04:31:44.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16252024-10-10T04:31:44.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16262024-10-10T04:31:44.577ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16272024-10-10T04:31:44.577ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
16282024-10-10T04:31:44.577ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16292024-10-10T04:31:44.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16302024-10-10T04:31:44.583ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16312024-10-10T04:31:44.584ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16322024-10-10T04:31:44.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16332024-10-10T04:31:44.585ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16342024-10-10T04:31:44.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16352024-10-10T04:31:44.587ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16362024-10-10T04:31:44.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16372024-10-10T04:31:44.587ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16382024-10-10T04:31:44.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16392024-10-10T04:31:44.588ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c original_time_created = 2024-10-10 04:25:36.941399 UTC target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c time_created = 2024-10-10 04:25:36.941399 UTC
16402024-10-10T04:31:44.588ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.914746ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1ba4e165-7586-4255-a320-af3c6bf6137c","time_created":"2024-10-10T04:25:36.941399Z"}
16412024-10-10T04:31:44.588ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16422024-10-10T04:31:44.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16432024-10-10T04:31:44.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
16442024-10-10T04:31:44.590ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
16452024-10-10T04:31:44.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
16462024-10-10T04:31:44.591ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16472024-10-10T04:31:44.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16482024-10-10T04:31:44.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16492024-10-10T04:31:44.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16502024-10-10T04:31:44.594ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
16512024-10-10T04:31:44.594ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
16522024-10-10T04:31:44.594ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 61.63049ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
16532024-10-10T04:31:44.595ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16542024-10-10T04:31:44.595ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16552024-10-10T04:31:44.596ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16562024-10-10T04:31:44.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16572024-10-10T04:31:44.598ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16582024-10-10T04:31:44.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16592024-10-10T04:31:44.598ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16602024-10-10T04:31:44.599ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16612024-10-10T04:31:44.599ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16622024-10-10T04:31:44.599ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16632024-10-10T04:31:44.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16642024-10-10T04:31:44.599ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16652024-10-10T04:31:44.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16662024-10-10T04:31:44.600ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16672024-10-10T04:31:44.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16682024-10-10T04:31:44.600ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
16692024-10-10T04:31:44.600ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
16702024-10-10T04:31:44.600ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
16712024-10-10T04:31:44.600ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16722024-10-10T04:31:44.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16732024-10-10T04:31:44.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16742024-10-10T04:31:44.600ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 9772f104-f050-4d64-ad07-7e3347035f74, lookup_type: ById(9772f104-f050-4d64-ad07-7e3347035f74) } result = Ok(())
16752024-10-10T04:31:44.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16762024-10-10T04:31:44.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16772024-10-10T04:31:44.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16782024-10-10T04:31:44.602ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16792024-10-10T04:31:44.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16802024-10-10T04:31:44.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16812024-10-10T04:31:44.602ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16822024-10-10T04:31:44.604ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.10013ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16832024-10-10T04:31:44.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
16842024-10-10T04:31:44.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
16852024-10-10T04:31:44.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
16862024-10-10T04:31:44.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16872024-10-10T04:31:44.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16882024-10-10T04:31:44.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16892024-10-10T04:31:44.609ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 76.299353ms iteration = 13 status = 0
16902024-10-10T04:31:44.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16912024-10-10T04:31:44.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16922024-10-10T04:31:44.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16932024-10-10T04:31:44.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16942024-10-10T04:31:44.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16952024-10-10T04:31:44.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16962024-10-10T04:31:44.613ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16972024-10-10T04:31:44.614ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.728684ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16982024-10-10T04:31:44.614ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 81.118335ms iteration = 4 status = {"nsuccess":5}
16992024-10-10T04:31:44.615ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
17002024-10-10T04:31:44.615ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = faa1bede-5675-4594-bc5b-032dee6c377c dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
17012024-10-10T04:31:44.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17022024-10-10T04:31:44.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17032024-10-10T04:31:44.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17042024-10-10T04:31:44.618ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17052024-10-10T04:31:44.618ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17062024-10-10T04:31:44.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17072024-10-10T04:31:44.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17082024-10-10T04:31:44.619ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
17092024-10-10T04:31:44.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17102024-10-10T04:31:44.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17112024-10-10T04:31:44.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17122024-10-10T04:31:44.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17132024-10-10T04:31:44.628ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = faa1bede-5675-4594-bc5b-032dee6c377c dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
17142024-10-10T04:31:44.629ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17152024-10-10T04:31:44.629ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-10-10 04:25:45.247702 UTC dns_group = internal generation = 1
17162024-10-10T04:31:44.629ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 96.063445ms iteration = 8 status = {"generation":1}
17172024-10-10T04:31:44.634ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17182024-10-10T04:31:44.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 102.469591ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17192024-10-10T04:31:44.635ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
17202024-10-10T04:31:44.635ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
17212024-10-10T04:31:44.635ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 102.731558ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
17222024-10-10T04:31:44.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
17232024-10-10T04:31:44.638ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17242024-10-10T04:31:44.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17252024-10-10T04:31:44.647ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
17262024-10-10T04:31:44.647ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
17272024-10-10T04:31:44.647ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
17282024-10-10T04:31:44.647ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17292024-10-10T04:31:44.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17302024-10-10T04:31:44.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17312024-10-10T04:31:44.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17322024-10-10T04:31:44.652ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17332024-10-10T04:31:44.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17342024-10-10T04:31:44.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17352024-10-10T04:31:44.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17362024-10-10T04:31:44.680ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17372024-10-10T04:31:44.680ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17382024-10-10T04:31:44.680ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 147.552767ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17392024-10-10T04:31:44.683ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
17402024-10-10T04:31:44.701ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17412024-10-10T04:31:44.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17422024-10-10T04:31:44.708ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
17432024-10-10T04:31:44.708ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a3659471-cbd0-4b22-b439-06b0609b45a5 dns_zone_name = oxide.test found_so_far = 0 version = 2
17442024-10-10T04:31:44.708ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17452024-10-10T04:31:44.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17462024-10-10T04:31:44.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17472024-10-10T04:31:44.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17482024-10-10T04:31:44.714ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17492024-10-10T04:31:44.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17502024-10-10T04:31:44.721ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a3659471-cbd0-4b22-b439-06b0609b45a5 dns_zone_name = oxide.test found_so_far = 1 version = 2
17512024-10-10T04:31:44.721ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
17522024-10-10T04:31:44.721ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-10-10 04:25:46.435736 UTC dns_group = external generation = 2
17532024-10-10T04:31:44.722ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 188.676266ms iteration = 8 status = {"generation":2}
17542024-10-10T04:31:44.729ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1060 zone_address = fd00:1122:3344:101::2
17552024-10-10T04:31:44.729ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17562024-10-10T04:31:44.730ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "037874c7-44e0-493e-a0eb-c1565b903c3d", "content-length": "26", "date": "Thu, 10 Oct 2024 04:31:43 GMT"} })
17572024-10-10T04:31:44.730ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1065 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17582024-10-10T04:31:44.732ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1097 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17592024-10-10T04:31:44.732ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
17602024-10-10T04:31:44.732ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 198.965729ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
17612024-10-10T04:31:44.744ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1060 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a zone_address = fd00:1122:3344:101::2
17622024-10-10T04:31:44.744ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17632024-10-10T04:31:44.744ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "390616fd-2ba9-4221-a894-2a47b13ae984", "content-length": "26", "date": "Thu, 10 Oct 2024 04:31:43 GMT"} })
17642024-10-10T04:31:44.744ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1065 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17652024-10-10T04:31:44.744ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17662024-10-10T04:31:44.746ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1097 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = fb9aa554-f959-49d5-975a-a4595288f00a
17672024-10-10T04:31:44.747ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 213.97521ms iteration = 15 status = {"physical_disks_added":0}
17682024-10-10T04:31:44.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17692024-10-10T04:31:44.747ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17702024-10-10T04:31:44.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17712024-10-10T04:31:44.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17722024-10-10T04:31:44.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17732024-10-10T04:31:44.845ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
17742024-10-10T04:31:44.898ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1060 zone_address = fd00:1122:3344:101::2
17752024-10-10T04:31:44.898ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17762024-10-10T04:31:44.899ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8bdb6387-6286-4d0c-bcf5-dc57fc160c89", "content-length": "26", "date": "Thu, 10 Oct 2024 04:31:44 GMT"} })
17772024-10-10T04:31:44.899ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1065 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17782024-10-10T04:31:44.901ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1097 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17792024-10-10T04:31:45.080ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 547.056529ms iteration = 13 status = {}
17802024-10-10T04:31:45.086ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17812024-10-10T04:31:45.086ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f28d3c5d-b9e1-4229-badb-2f9b2e1b938b", "content-length": "2", "date": "Thu, 10 Oct 2024 04:31:44 GMT"} })
17822024-10-10T04:31:45.088ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17832024-10-10T04:31:45.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17842024-10-10T04:31:45.092ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
17852024-10-10T04:31:45.093ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8ca468d5-19aa-49bc-a36d-995885d3b164", "date": "Thu, 10 Oct 2024 04:31:45 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17862024-10-10T04:31:45.093ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17872024-10-10T04:31:45.095ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d095a9bd-4c8d-4f8d-8ac3-6249bf6111eb", "date": "Thu, 10 Oct 2024 04:31:45 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17882024-10-10T04:31:45.095ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17892024-10-10T04:31:45.098ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
17902024-10-10T04:31:45.098ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 564.93024ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
17912024-10-10T04:31:45.113ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
17922024-10-10T04:31:45.118ZINFOnexus (BackgroundTasks): VPC route manager sled 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17932024-10-10T04:31:45.118ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17942024-10-10T04:31:45.118ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "79c2cd38-93b5-4909-bc96-f0c198d8c4ff", "content-length": "372", "date": "Thu, 10 Oct 2024 04:31:44 GMT"} })
17952024-10-10T04:31:45.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17962024-10-10T04:31:45.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17972024-10-10T04:31:45.120ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17982024-10-10T04:31:45.120ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 587.88988ms iteration = 13 status = null
17992024-10-10T04:31:45.122ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18002024-10-10T04:31:45.122ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18012024-10-10T04:31:45.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18022024-10-10T04:31:45.124ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18032024-10-10T04:31:45.125ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18042024-10-10T04:31:45.125ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18052024-10-10T04:31:45.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18062024-10-10T04:31:45.134ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
18072024-10-10T04:31:45.134ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
18082024-10-10T04:31:45.134ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d82aa545-5b6b-4f97-a85b-a390c75354fc", "date": "Thu, 10 Oct 2024 04:31:44 GMT"} })
18092024-10-10T04:31:45.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18102024-10-10T04:31:45.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18112024-10-10T04:31:45.136ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18122024-10-10T04:31:45.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18132024-10-10T04:31:45.140ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18142024-10-10T04:31:45.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18152024-10-10T04:31:45.142ZINFOnexus (BackgroundTasks): VPC route manager sled 9772f104-f050-4d64-ad07-7e3347035f74 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
18162024-10-10T04:31:45.142ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
18172024-10-10T04:31:45.143ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1eaebc62-f12e-46ae-8867-35de2d4a6878", "date": "Thu, 10 Oct 2024 04:31:44 GMT"} })
18182024-10-10T04:31:45.146ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 613.128182ms iteration = 17 status = {}
18192024-10-10T04:31:45.155ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-10-10T04:25:42.021839Z, time_modified: 2024-10-10T04:25:42.021839Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, db_silo: Silo { identity: SiloIdentity { id: 1104c51c-4e42-4c05-99d9-0e655da0191e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-10T04:25:46.382172Z, time_modified: 2024-10-10T04:25:46.382172Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "666653ed681e8582d913e07a59566200abc7216bb4bc8c8f89cf34a3eafa830c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 1104c51c-4e42-4c05-99d9-0e655da0191e, db_silo: Silo { identity: SiloIdentity { id: 1104c51c-4e42-4c05-99d9-0e655da0191e, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-10-10T04:25:46.382172Z, time_modified: 2024-10-10T04:25:46.382172Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "666653ed681e8582d913e07a59566200abc7216bb4bc8c8f89cf34a3eafa830c" }] }) }
18202024-10-10T04:31:45.155ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 622.14747ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"1104c51c-4e42-4c05-99d9-0e655da0191e","tls_certs":["666653ed681e8582d913e07a59566200abc7216bb4bc8c8f89cf34a3eafa830c"]}},"default_endpoint":{"silo_id":"1104c51c-4e42-4c05-99d9-0e655da0191e","tls_certs":["666653ed681e8582d913e07a59566200abc7216bb4bc8c8f89cf34a3eafa830c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
18212024-10-10T04:31:45.192ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
18222024-10-10T04:31:45.192ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b0cda14f-b138-45b9-a464-cdb738ae94ca", "date": "Thu, 10 Oct 2024 04:31:45 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
18232024-10-10T04:31:45.192ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
18242024-10-10T04:31:45.194ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9aa6c6c5-f77a-443a-b7b1-8df386ed6eec", "date": "Thu, 10 Oct 2024 04:31:45 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
18252024-10-10T04:31:45.194ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
18262024-10-10T04:31:45.195ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "272821ea-41c4-4be3-84ce-fa7081ee05b5", "date": "Thu, 10 Oct 2024 04:31:45 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
18272024-10-10T04:31:45.195ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
18282024-10-10T04:31:45.198ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353] }
18292024-10-10T04:31:45.198ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 665.136329ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
18302024-10-10T04:31:45.283ZDEBGnexus (BackgroundTasks): client request SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18312024-10-10T04:31:45.284ZDEBGnexus (BackgroundTasks): client response SledAgent = 9772f104-f050-4d64-ad07-7e3347035f74 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "615829b0-83fe-46d4-847d-f3d11c60e7c9", "content-length": "691", "date": "Thu, 10 Oct 2024 04:31:45 GMT"} })
18322024-10-10T04:31:45.284ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
18332024-10-10T04:31:45.284ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18342024-10-10T04:31:45.284ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18352024-10-10T04:31:45.285ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 752.054405ms iteration = 15 status = {}
18362024-10-10T04:31:45.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18372024-10-10T04:31:45.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18382024-10-10T04:31:45.310ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ca93cde9-a76e-4d6d-8179-1b6e1a0745b6, rack_id: fb9aa554-f959-49d5-975a-a4595288f00a, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(2631167f-aa2a-400a-aa67-8033c4a469e6) } rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch_location = Switch0
18392024-10-10T04:31:45.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18402024-10-10T04:31:45.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18412024-10-10T04:31:45.320ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18422024-10-10T04:31:45.320ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "11149883-b3e5-40df-ba2a-576cf75d2c58", "content-length": "121", "date": "Thu, 10 Oct 2024 04:31:45 GMT"} })
18432024-10-10T04:31:45.320ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1720 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
18442024-10-10T04:31:45.320ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 2631167f-aa2a-400a-aa67-8033c4a469e6
18452024-10-10T04:31:45.320ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18462024-10-10T04:31:45.320ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18472024-10-10T04:31:45.320ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18482024-10-10T04:31:45.320ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18492024-10-10T04:31:45.320ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18502024-10-10T04:31:45.320ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1894 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18512024-10-10T04:31:45.320ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18522024-10-10T04:31:45.320ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1930 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18532024-10-10T04:31:45.321ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a
18542024-10-10T04:31:45.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18552024-10-10T04:31:45.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18562024-10-10T04:31:45.323ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18572024-10-10T04:31:45.323ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2986ef53-3d14-41ab-90e4-80baaa51a50d", "content-length": "2", "date": "Thu, 10 Oct 2024 04:31:45 GMT"} })
18582024-10-10T04:31:45.323ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18592024-10-10T04:31:45.323ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "75153b48-879d-4c45-bbb2-0126c148adff", "content-length": "52", "date": "Thu, 10 Oct 2024 04:31:45 GMT"} })
18602024-10-10T04:31:45.323ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch_location = Switch0
18612024-10-10T04:31:45.323ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18622024-10-10T04:31:45.408ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "53bed8c1-934b-4b4b-913e-4324f9ec7fe7", "date": "Thu, 10 Oct 2024 04:31:45 GMT"} })
18632024-10-10T04:31:45.408ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = fb9aa554-f959-49d5-975a-a4595288f00a switch = Switch0
18642024-10-10T04:31:45.408ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = fb9aa554-f959-49d5-975a-a4595288f00a uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18652024-10-10T04:31:45.409ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = fb9aa554-f959-49d5-975a-a4595288f00a result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c24040e-39aa-4146-b262-e3d2a4f8e089", "content-length": "669", "date": "Thu, 10 Oct 2024 04:31:45 GMT"} })
18662024-10-10T04:31:45.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18672024-10-10T04:31:45.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18682024-10-10T04:31:45.412ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18692024-10-10T04:31:45.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18702024-10-10T04:31:45.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18712024-10-10T04:31:45.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18722024-10-10T04:31:45.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18732024-10-10T04:31:45.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18742024-10-10T04:31:45.427ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 894.194075ms iteration = 13 status = {}
18752024-10-10T04:31:47.601ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:45995
18762024-10-10T04:31:47.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45995 req_id = 7f699a94-e2d7-47dd-8f9c-9ec95c1d2aff roles = RoleSet { roles: {} } uri = /metrics/producers
18772024-10-10T04:31:47.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45995 req_id = 7f699a94-e2d7-47dd-8f9c-9ec95c1d2aff resource = Database result = Ok(()) uri = /metrics/producers
18782024-10-10T04:31:47.667ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:326 id = 79488ebd-ca89-4737-be0d-354826998905
18792024-10-10T04:31:47.668ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = 79488ebd-ca89-4737-be0d-354826998905 uri = http://[fd00:1122:3344:101::d]:12223/producers
18802024-10-10T04:31:47.668ZDEBGnexus: client response oximeter-collector = 79488ebd-ca89-4737-be0d-354826998905 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers", status: 204, headers: {"x-request-id": "ab789010-144a-4729-ad07-e047a47aac7b", "date": "Thu, 10 Oct 2024 04:31:47 GMT"} })
18812024-10-10T04:31:47.668ZINFOnexus: assigned collector to new producer collector_id = 79488ebd-ca89-4737-be0d-354826998905 file = nexus/src/app/oximeter.rs:133 producer_id = af9f1c1e-2b23-4aad-a95e-720c1420f92c
18822024-10-10T04:31:47.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 68819 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:45995 req_id = 7f699a94-e2d7-47dd-8f9c-9ec95c1d2aff response_code = 201 uri = /metrics/producers
18832024-10-10T04:31:47.864ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2625 local_addr = [fd00:1122:3344:101::a]:52536 method = GET remote_addr = [fd00:1122:3344:101::d]:49035 req_id = 0a4e4c75-e7ee-4bb8-a1ca-ebdf1fe27ede response_code = 200 uri = /6428ed70-db9f-4da8-8d9d-b09c2dd1c036
18842024-10-10T04:31:54.533ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
18852024-10-10T04:31:54.533ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
18862024-10-10T04:31:54.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18872024-10-10T04:31:54.533ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18882024-10-10T04:31:54.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18892024-10-10T04:31:54.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18902024-10-10T04:31:54.535ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18912024-10-10T04:31:54.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18922024-10-10T04:31:54.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18932024-10-10T04:31:54.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.095562ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18942024-10-10T04:31:54.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18952024-10-10T04:31:54.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18962024-10-10T04:31:54.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18972024-10-10T04:31:54.540ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18982024-10-10T04:31:54.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18992024-10-10T04:31:54.542ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19002024-10-10T04:31:54.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 1ba4e165-7586-4255-a320-af3c6bf6137c, lookup_type: ById(1ba4e165-7586-4255-a320-af3c6bf6137c) } result = Ok(())
19012024-10-10T04:31:54.544ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19022024-10-10T04:31:54.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19032024-10-10T04:31:54.553ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c original_time_created = 2024-10-10 04:25:36.941399 UTC target_id = 1ba4e165-7586-4255-a320-af3c6bf6137c time_created = 2024-10-10 04:25:36.941399 UTC
19042024-10-10T04:31:54.553ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.41394ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"1ba4e165-7586-4255-a320-af3c6bf6137c","time_created":"2024-10-10T04:25:36.941399Z"}
19052024-10-10T04:31:57.864ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2409 local_addr = [fd00:1122:3344:101::a]:52536 method = GET remote_addr = [fd00:1122:3344:101::d]:49035 req_id = cfbc074d-b30e-480c-8e17-c2e81a74e276 response_code = 200 uri = /6428ed70-db9f-4da8-8d9d-b09c2dd1c036
19062024-10-10T04:32:00.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41151 req_id = 02567022-2d2e-48b4-b0f6-93580b7e58fb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/13?limit=100
19072024-10-10T04:32:00.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41151 req_id = 02567022-2d2e-48b4-b0f6-93580b7e58fb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/13?limit=100
19082024-10-10T04:32:00.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3516 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:41151 req_id = 02567022-2d2e-48b4-b0f6-93580b7e58fb response_code = 200 uri = /nat/ipv4/changeset/13?limit=100