Max level shown:
12024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
22024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
32024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
52024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
62024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
82024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
92024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
102024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
112024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
122024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
132024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
142024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
152024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
162024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
172024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
182024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
192024-12-21T06:15:00.350ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 7c419228-2431-4394-af83-ea0457364b70
202024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
212024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.51\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"7c419228-2431-4394-af83-ea0457364b70"}
222024-12-21T06:15:00.350ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 06:05:00.350421166 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
232024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
242024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
252024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
262024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
272024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
282024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
292024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
302024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
312024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
322024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
332024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
342024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
352024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
362024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
372024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
382024-12-21T06:15:00.350ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
392024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
402024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
412024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
422024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
432024-12-21T06:15:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
442024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
452024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
462024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
472024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
482024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
492024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
502024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
512024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
522024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
532024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
542024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
552024-12-21T06:15:00.351ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1031, tv_nsec: 435762932 } })
562024-12-21T06:15:00.351ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("068965c6-3480-4953-b57e-dd969abb2a21.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("45c0a855-5592-491c-b7b3-470902319db2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1031, tv_nsec: 435777933 } })
572024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
582024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
592024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
602024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
612024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
622024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
632024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
642024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
652024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
662024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
672024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
682024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.273086ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
692024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
702024-12-21T06:15:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.405289ms iteration = 3 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
712024-12-21T06:15:00.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
722024-12-21T06:15:00.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
732024-12-21T06:15:00.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1031, tv_nsec: 438939720 } })
742024-12-21T06:15:00.354ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
752024-12-21T06:15:00.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
762024-12-21T06:15:00.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
772024-12-21T06:15:00.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
782024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
792024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
802024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
812024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
822024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
832024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
842024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
852024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
862024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
872024-12-21T06:15:00.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
882024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
892024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
902024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
912024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
922024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
932024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
942024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
952024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
962024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
972024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
982024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
992024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1002024-12-21T06:15:00.356ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 06:05:00.350421166 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
1012024-12-21T06:15:00.356ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.377827ms iteration = 2 status = {"expiration":"2024-12-21T06:05:00.350421166Z","pruned":[]}
1022024-12-21T06:15:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1032024-12-21T06:15:00.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1042024-12-21T06:15:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1052024-12-21T06:15:00.361ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1031, tv_nsec: 446555842 } })
1062024-12-21T06:15:00.362ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
1072024-12-21T06:15:00.362ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1082024-12-21T06:15:00.363ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1092024-12-21T06:15:00.365ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1102024-12-21T06:15:00.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1112024-12-21T06:15:00.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1122024-12-21T06:15:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1132024-12-21T06:15:00.367ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1142024-12-21T06:15:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1152024-12-21T06:15:00.367ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1162024-12-21T06:15:00.369ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1172024-12-21T06:15:00.370ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 19.771948ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1182024-12-21T06:15:00.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1192024-12-21T06:15:00.371ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1202024-12-21T06:15:00.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1212024-12-21T06:15:00.373ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
1222024-12-21T06:15:00.376ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.18602ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
1232024-12-21T06:15:00.376ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 20.381095ms iteration = 3 status = {"errors":[],"finish_invoked_ok":[]}
1242024-12-21T06:15:00.377ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1252024-12-21T06:15:00.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1262024-12-21T06:15:00.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1272024-12-21T06:15:00.379ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1282024-12-21T06:15:00.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1292024-12-21T06:15:00.380ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
1302024-12-21T06:15:00.380ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
1312024-12-21T06:15:00.380ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 24.134249ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
1322024-12-21T06:15:00.380ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1332024-12-21T06:15:00.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1342024-12-21T06:15:00.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1352024-12-21T06:15:00.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1362024-12-21T06:15:00.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
1372024-12-21T06:15:00.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1382024-12-21T06:15:00.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1392024-12-21T06:15:00.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1402024-12-21T06:15:00.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1412024-12-21T06:15:00.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1422024-12-21T06:15:00.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1432024-12-21T06:15:00.403ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1442024-12-21T06:15:00.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
1452024-12-21T06:15:00.406ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1462024-12-21T06:15:00.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1472024-12-21T06:15:00.408ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1482024-12-21T06:15:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1492024-12-21T06:15:00.411ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1502024-12-21T06:15:00.411ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1512024-12-21T06:15:00.411ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1522024-12-21T06:15:00.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1532024-12-21T06:15:00.412ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1542024-12-21T06:15:00.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1552024-12-21T06:15:00.414ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.674226ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
1562024-12-21T06:15:00.416ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1572024-12-21T06:15:00.416ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1582024-12-21T06:15:00.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1592024-12-21T06:15:00.419ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1602024-12-21T06:15:00.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
1612024-12-21T06:15:00.420ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1622024-12-21T06:15:00.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
1632024-12-21T06:15:00.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
1642024-12-21T06:15:00.421ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1652024-12-21T06:15:00.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1662024-12-21T06:15:00.423ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1672024-12-21T06:15:00.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1682024-12-21T06:15:00.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1692024-12-21T06:15:00.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1702024-12-21T06:15:00.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1712024-12-21T06:15:00.424ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.296334ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
1722024-12-21T06:15:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
1732024-12-21T06:15:00.424ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1742024-12-21T06:15:00.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1752024-12-21T06:15:00.426ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
1762024-12-21T06:15:00.426ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
1772024-12-21T06:15:00.426ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
1782024-12-21T06:15:00.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1792024-12-21T06:15:00.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1802024-12-21T06:15:00.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1812024-12-21T06:15:00.431ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1822024-12-21T06:15:00.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1832024-12-21T06:15:00.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
1842024-12-21T06:15:00.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1852024-12-21T06:15:00.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1862024-12-21T06:15:00.438ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
1872024-12-21T06:15:00.438ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
1882024-12-21T06:15:00.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1892024-12-21T06:15:00.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1902024-12-21T06:15:00.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1912024-12-21T06:15:00.444ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
1922024-12-21T06:15:00.444ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 92.196677ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
1932024-12-21T06:15:00.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
1942024-12-21T06:15:00.445ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1952024-12-21T06:15:00.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1962024-12-21T06:15:00.447ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1972024-12-21T06:15:00.447ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
1982024-12-21T06:15:00.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1992024-12-21T06:15:00.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2002024-12-21T06:15:00.454ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
2012024-12-21T06:15:00.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
2022024-12-21T06:15:00.468ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
2032024-12-21T06:15:00.468ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
2042024-12-21T06:15:00.468ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 06:14:07.931887 UTC dns_group = internal generation = 1
2052024-12-21T06:15:00.468ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 118.014603ms iteration = 3 status = {"generation":1}
2062024-12-21T06:15:00.471ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 120.180583ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2072024-12-21T06:15:00.472ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2082024-12-21T06:15:00.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2092024-12-21T06:15:00.472ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 116.699247ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2102024-12-21T06:15:00.473ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2112024-12-21T06:15:00.473ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2122024-12-21T06:15:00.473ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2132024-12-21T06:15:00.473ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2142024-12-21T06:15:00.473ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2152024-12-21T06:15:00.473ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2162024-12-21T06:15:00.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2172024-12-21T06:15:00.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2182024-12-21T06:15:00.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2192024-12-21T06:15:00.473ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
2202024-12-21T06:15:00.474ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
2212024-12-21T06:15:00.474ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 123.073604ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
2222024-12-21T06:15:00.475ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2232024-12-21T06:15:00.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2242024-12-21T06:15:00.475ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2252024-12-21T06:15:00.476ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
2262024-12-21T06:15:00.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2272024-12-21T06:15:00.478ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2282024-12-21T06:15:00.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2292024-12-21T06:15:00.479ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2302024-12-21T06:15:00.479ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2312024-12-21T06:15:00.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2322024-12-21T06:15:00.481ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2332024-12-21T06:15:00.481ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2342024-12-21T06:15:00.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2352024-12-21T06:15:00.495ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2362024-12-21T06:15:00.495ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2372024-12-21T06:15:00.496ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "99fe64e3-cd09-45a3-bcc0-b599a6173f48", "content-length": "26", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} })
2382024-12-21T06:15:00.496ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2392024-12-21T06:15:00.498ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 147.84662ms iteration = 6 status = {"physical_disks_added":0}
2402024-12-21T06:15:00.498ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2412024-12-21T06:15:00.512ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2422024-12-21T06:15:00.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2432024-12-21T06:15:00.521ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2442024-12-21T06:15:00.521ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2452024-12-21T06:15:00.521ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 170.609182ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2462024-12-21T06:15:00.521ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1031, tv_nsec: 606238911 } })
2472024-12-21T06:15:00.522ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
2482024-12-21T06:15:00.523ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
2492024-12-21T06:15:00.523ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 173.346537ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
2502024-12-21T06:15:00.523ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2512024-12-21T06:15:00.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2522024-12-21T06:15:00.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2532024-12-21T06:15:00.528ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 172.136865ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
2542024-12-21T06:15:00.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2552024-12-21T06:15:00.530ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2562024-12-21T06:15:00.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
2572024-12-21T06:15:00.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2582024-12-21T06:15:00.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2592024-12-21T06:15:00.535ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
2602024-12-21T06:15:00.535ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 0 version = 2
2612024-12-21T06:15:00.535ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2622024-12-21T06:15:00.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2632024-12-21T06:15:00.536ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 185.177016ms iteration = 3 status = 0
2642024-12-21T06:15:00.548ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T06:13:58.796551Z, time_modified: 2024-12-21T06:13:58.796551Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
2652024-12-21T06:15:00.548ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 197.59741ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]}},"default_endpoint":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
2662024-12-21T06:15:00.549ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2672024-12-21T06:15:00.552ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2682024-12-21T06:15:00.552ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2692024-12-21T06:15:00.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2702024-12-21T06:15:00.565ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 1 version = 2
2712024-12-21T06:15:00.565ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
2722024-12-21T06:15:00.565ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 06:14:08.776888 UTC dns_group = external generation = 2
2732024-12-21T06:15:00.565ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 215.096116ms iteration = 3 status = {"generation":2}
2742024-12-21T06:15:00.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 997f5107-a3a4-42f8-93be-53ce199ab379 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
2752024-12-21T06:15:00.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 997f5107-a3a4-42f8-93be-53ce199ab379 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
2762024-12-21T06:15:00.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 997f5107-a3a4-42f8-93be-53ce199ab379 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
2772024-12-21T06:15:00.600ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
2782024-12-21T06:15:00.600ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 249.572231ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
2792024-12-21T06:15:00.640ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2802024-12-21T06:15:00.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2812024-12-21T06:15:00.642ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2822024-12-21T06:15:00.642ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
2832024-12-21T06:15:00.642ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2842024-12-21T06:15:00.643ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2852024-12-21T06:15:00.643ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5a2af2ba-7c01-4262-a3da-37bb2372621e", "content-length": "26", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} })
2862024-12-21T06:15:00.643ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2872024-12-21T06:15:00.644ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2882024-12-21T06:15:00.644ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2892024-12-21T06:15:00.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2902024-12-21T06:15:00.644ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2912024-12-21T06:15:00.646ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2922024-12-21T06:15:00.648ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2932024-12-21T06:15:00.648ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2942024-12-21T06:15:00.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2952024-12-21T06:15:00.765ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
2962024-12-21T06:15:00.765ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "060cb1dd-568d-429f-b47d-f7a8e0edb06b", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
2972024-12-21T06:15:00.765ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
2982024-12-21T06:15:00.766ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8bf71d06-f549-4217-86a6-404a8f999e09", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
2992024-12-21T06:15:00.766ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3002024-12-21T06:15:00.769ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
3012024-12-21T06:15:00.769ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 418.932139ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
3022024-12-21T06:15:00.823ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
3032024-12-21T06:15:00.824ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
3042024-12-21T06:15:00.824ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
3052024-12-21T06:15:00.825ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c43ff7db-bcff-4cae-80e5-6e6875f491f5", "content-length": "26", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} })
3062024-12-21T06:15:00.825ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
3072024-12-21T06:15:00.827ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
3082024-12-21T06:15:00.887ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
3092024-12-21T06:15:00.887ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3102024-12-21T06:15:00.888ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "51839cec-5422-4998-9ad9-0575cccb0469", "content-length": "372", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} })
3112024-12-21T06:15:00.888ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3122024-12-21T06:15:00.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3132024-12-21T06:15:00.908ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3142024-12-21T06:15:00.908ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "008b4780-646d-4603-b6c0-40ac831cb1f9", "content-length": "691", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} })
3152024-12-21T06:15:00.908ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
3162024-12-21T06:15:00.908ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
3172024-12-21T06:15:00.908ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
3182024-12-21T06:15:00.910ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 559.21569ms iteration = 3 status = {}
3192024-12-21T06:15:00.913ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3202024-12-21T06:15:00.913ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b403c40-81b5-485b-a315-440c2e7daf45", "content-length": "1", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} })
3212024-12-21T06:15:00.915ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3222024-12-21T06:15:00.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3232024-12-21T06:15:00.923ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 572.877939ms iteration = 3 status = null
3242024-12-21T06:15:00.958ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 607.973562ms iteration = 3 status = {}
3252024-12-21T06:15:00.959ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
3262024-12-21T06:15:00.959ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3272024-12-21T06:15:00.959ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e5f21464-2e53-42f3-99cf-35ed316e4de6", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} })
3282024-12-21T06:15:00.959ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3292024-12-21T06:15:00.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3302024-12-21T06:15:00.961ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3312024-12-21T06:15:00.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3322024-12-21T06:15:00.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3332024-12-21T06:15:00.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3342024-12-21T06:15:00.969ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3352024-12-21T06:15:00.969ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3362024-12-21T06:15:00.970ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7bf0da79-6d7a-4206-b2b9-19473f88ab73", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} })
3372024-12-21T06:15:00.971ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 615.429239ms iteration = 4 status = {}
3382024-12-21T06:15:01.019ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
3392024-12-21T06:15:01.020ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5fe8f688-9ce4-4555-afa9-fe13d1f9cf21", "date": "Sat, 21 Dec 2024 06:15:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
3402024-12-21T06:15:01.020ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
3412024-12-21T06:15:01.022ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "decf6de7-05d1-416d-9635-be445df10e22", "date": "Sat, 21 Dec 2024 06:15:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
3422024-12-21T06:15:01.022ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
3432024-12-21T06:15:01.024ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "71cfa821-83a5-439c-92d6-c113539348e5", "date": "Sat, 21 Dec 2024 06:15:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
3442024-12-21T06:15:01.024ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
3452024-12-21T06:15:01.026ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
3462024-12-21T06:15:01.026ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 676.149183ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
3472024-12-21T06:15:01.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3482024-12-21T06:15:01.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3492024-12-21T06:15:01.090ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
3502024-12-21T06:15:01.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3512024-12-21T06:15:01.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3522024-12-21T06:15:01.101ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
3532024-12-21T06:15:01.102ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ab50dc5-ce83-4e06-8e93-b2ee7f6660c0", "content-length": "134", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} })
3542024-12-21T06:15:01.102ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
3552024-12-21T06:15:01.102ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
3562024-12-21T06:15:01.102ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
3572024-12-21T06:15:01.102ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3582024-12-21T06:15:01.102ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3592024-12-21T06:15:01.102ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3602024-12-21T06:15:01.102ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3612024-12-21T06:15:01.102ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3622024-12-21T06:15:01.102ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3632024-12-21T06:15:01.102ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3642024-12-21T06:15:01.103ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
3652024-12-21T06:15:01.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3662024-12-21T06:15:01.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3672024-12-21T06:15:01.106ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
3682024-12-21T06:15:01.106ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3bd0575-ca49-4cbd-bbe7-ce5a3ad604c8", "content-length": "2", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} })
3692024-12-21T06:15:01.106ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
3702024-12-21T06:15:01.106ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "95bbaa48-3f41-4114-a911-5dbf25bc45f2", "content-length": "52", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} })
3712024-12-21T06:15:01.106ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
3722024-12-21T06:15:01.106ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3732024-12-21T06:15:01.278ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "289ed784-75fb-4d1b-a108-d9984236b5c3", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} })
3742024-12-21T06:15:01.278ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
3752024-12-21T06:15:01.278ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3762024-12-21T06:15:01.278ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc2178d6-e1dc-4a67-b690-41253dca31f1", "content-length": "682", "date": "Sat, 21 Dec 2024 06:15:00 GMT"} })
3772024-12-21T06:15:01.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3782024-12-21T06:15:01.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3792024-12-21T06:15:01.290ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3802024-12-21T06:15:01.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3812024-12-21T06:15:01.295ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3822024-12-21T06:15:01.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3832024-12-21T06:15:01.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3842024-12-21T06:15:01.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3852024-12-21T06:15:01.330ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 979.928027ms iteration = 3 status = {}
3862024-12-21T06:15:01.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ba09cc82-8e7e-4539-9f9e-f47a593c4512 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
3872024-12-21T06:15:01.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ba09cc82-8e7e-4539-9f9e-f47a593c4512 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
3882024-12-21T06:15:01.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ba09cc82-8e7e-4539-9f9e-f47a593c4512 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
3892024-12-21T06:15:01.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 5076327a-a92e-4697-9dd1-7460f1acaf05 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
3902024-12-21T06:15:01.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 5076327a-a92e-4697-9dd1-7460f1acaf05 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
3912024-12-21T06:15:01.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9710 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 5076327a-a92e-4697-9dd1-7460f1acaf05 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
3922024-12-21T06:15:02.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = db17c07c-2667-43b6-b432-7150f42f15c8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
3932024-12-21T06:15:02.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = db17c07c-2667-43b6-b432-7150f42f15c8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
3942024-12-21T06:15:02.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = db17c07c-2667-43b6-b432-7150f42f15c8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
3952024-12-21T06:15:03.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 469b0dbe-8296-455e-8e38-d3f0f3fec076 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
3962024-12-21T06:15:03.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 469b0dbe-8296-455e-8e38-d3f0f3fec076 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
3972024-12-21T06:15:03.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 469b0dbe-8296-455e-8e38-d3f0f3fec076 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
3982024-12-21T06:15:03.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1338 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 5bc28ebe-54e2-4140-8f5f-598fbc7b9e6f response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
3992024-12-21T06:15:04.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 60d0d6ad-6d44-4017-b455-32bcba0ff7d3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4002024-12-21T06:15:04.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 60d0d6ad-6d44-4017-b455-32bcba0ff7d3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4012024-12-21T06:15:04.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 60d0d6ad-6d44-4017-b455-32bcba0ff7d3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4022024-12-21T06:15:05.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 49d8b439-a8ac-4e34-a4d0-05911f32706e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4032024-12-21T06:15:05.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 49d8b439-a8ac-4e34-a4d0-05911f32706e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4042024-12-21T06:15:05.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 49d8b439-a8ac-4e34-a4d0-05911f32706e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4052024-12-21T06:15:06.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 75713f43-20fb-4872-8b70-0ef1c371c295 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4062024-12-21T06:15:06.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 75713f43-20fb-4872-8b70-0ef1c371c295 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4072024-12-21T06:15:06.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2573 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 75713f43-20fb-4872-8b70-0ef1c371c295 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4082024-12-21T06:15:07.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5766ef80-4b02-4891-8db5-a7cc7a2e1f9b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4092024-12-21T06:15:07.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5766ef80-4b02-4891-8db5-a7cc7a2e1f9b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4102024-12-21T06:15:07.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5766ef80-4b02-4891-8db5-a7cc7a2e1f9b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4112024-12-21T06:15:08.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c73c492f-7dcd-4d80-abbc-d8c5de96ed7b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4122024-12-21T06:15:08.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c73c492f-7dcd-4d80-abbc-d8c5de96ed7b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4132024-12-21T06:15:08.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2811 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c73c492f-7dcd-4d80-abbc-d8c5de96ed7b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4142024-12-21T06:15:09.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 911cfaf1-e42d-4acc-934b-d91bae13c109 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4152024-12-21T06:15:09.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 911cfaf1-e42d-4acc-934b-d91bae13c109 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4162024-12-21T06:15:09.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 911cfaf1-e42d-4acc-934b-d91bae13c109 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4172024-12-21T06:15:10.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
4182024-12-21T06:15:10.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4192024-12-21T06:15:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4202024-12-21T06:15:10.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
4212024-12-21T06:15:10.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4222024-12-21T06:15:10.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4232024-12-21T06:15:10.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4242024-12-21T06:15:10.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4252024-12-21T06:15:10.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4262024-12-21T06:15:10.354ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.506418ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4272024-12-21T06:15:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4282024-12-21T06:15:10.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4292024-12-21T06:15:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4302024-12-21T06:15:10.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4312024-12-21T06:15:10.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4322024-12-21T06:15:10.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4332024-12-21T06:15:10.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
4342024-12-21T06:15:10.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4352024-12-21T06:15:10.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4362024-12-21T06:15:10.374ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
4372024-12-21T06:15:10.374ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.845509ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
4382024-12-21T06:15:10.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9ff53130-8935-4dc8-848b-646aa6634baa roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4392024-12-21T06:15:10.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9ff53130-8935-4dc8-848b-646aa6634baa resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4402024-12-21T06:15:10.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9ff53130-8935-4dc8-848b-646aa6634baa response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4412024-12-21T06:15:11.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ae980374-330a-4ae0-b1db-3729678624ce roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4422024-12-21T06:15:11.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ae980374-330a-4ae0-b1db-3729678624ce resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4432024-12-21T06:15:11.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ae980374-330a-4ae0-b1db-3729678624ce response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4442024-12-21T06:15:12.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d96e9bd9-beb1-41ba-beef-e36ba9c4606c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4452024-12-21T06:15:12.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d96e9bd9-beb1-41ba-beef-e36ba9c4606c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4462024-12-21T06:15:12.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d96e9bd9-beb1-41ba-beef-e36ba9c4606c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4472024-12-21T06:15:13.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 55c842b6-50b1-4acc-816b-e4476ed0c7f7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4482024-12-21T06:15:13.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 55c842b6-50b1-4acc-816b-e4476ed0c7f7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4492024-12-21T06:15:13.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 55c842b6-50b1-4acc-816b-e4476ed0c7f7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4502024-12-21T06:15:13.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = cc4bb8a6-4817-4e4c-9907-45cb6540bae8 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
4512024-12-21T06:15:13.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = cc4bb8a6-4817-4e4c-9907-45cb6540bae8 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
4522024-12-21T06:15:13.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = cc4bb8a6-4817-4e4c-9907-45cb6540bae8 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
4532024-12-21T06:15:13.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = 16754734-464c-4550-b188-0ad824bd8341 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
4542024-12-21T06:15:13.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = 16754734-464c-4550-b188-0ad824bd8341 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
4552024-12-21T06:15:13.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = 16754734-464c-4550-b188-0ad824bd8341 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
4562024-12-21T06:15:13.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1346 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 733d3536-0712-4d8d-a50f-5557a623a550 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
4572024-12-21T06:15:14.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3dcf2e04-764c-4195-af91-2de6cd8a6517 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4582024-12-21T06:15:14.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3dcf2e04-764c-4195-af91-2de6cd8a6517 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4592024-12-21T06:15:14.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3dcf2e04-764c-4195-af91-2de6cd8a6517 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4602024-12-21T06:15:15.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 79b465c9-3cde-4b59-ac98-1536d163fc1b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4612024-12-21T06:15:15.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 79b465c9-3cde-4b59-ac98-1536d163fc1b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4622024-12-21T06:15:15.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 79b465c9-3cde-4b59-ac98-1536d163fc1b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4632024-12-21T06:15:16.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2247ade2-9c02-4c0f-91f3-52ceaaa4a788 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4642024-12-21T06:15:16.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2247ade2-9c02-4c0f-91f3-52ceaaa4a788 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4652024-12-21T06:15:16.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2247ade2-9c02-4c0f-91f3-52ceaaa4a788 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4662024-12-21T06:15:17.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b98624e0-aec2-4d56-b29b-e622d6b13fcc roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4672024-12-21T06:15:17.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b98624e0-aec2-4d56-b29b-e622d6b13fcc resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4682024-12-21T06:15:17.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b98624e0-aec2-4d56-b29b-e622d6b13fcc response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4692024-12-21T06:15:19.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eb80b8f8-c20a-4478-993d-8154016db339 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4702024-12-21T06:15:19.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eb80b8f8-c20a-4478-993d-8154016db339 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4712024-12-21T06:15:19.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eb80b8f8-c20a-4478-993d-8154016db339 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4722024-12-21T06:15:20.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bbd04b25-3fe6-472e-895d-604bf496f947 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4732024-12-21T06:15:20.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bbd04b25-3fe6-472e-895d-604bf496f947 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4742024-12-21T06:15:20.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bbd04b25-3fe6-472e-895d-604bf496f947 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4752024-12-21T06:15:20.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
4762024-12-21T06:15:20.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4772024-12-21T06:15:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4782024-12-21T06:15:20.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
4792024-12-21T06:15:20.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4802024-12-21T06:15:20.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4812024-12-21T06:15:20.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4822024-12-21T06:15:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4832024-12-21T06:15:20.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4842024-12-21T06:15:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4852024-12-21T06:15:20.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4862024-12-21T06:15:20.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4872024-12-21T06:15:20.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4882024-12-21T06:15:20.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
4892024-12-21T06:15:20.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4902024-12-21T06:15:20.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4912024-12-21T06:15:20.377ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
4922024-12-21T06:15:20.377ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.774052ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
4932024-12-21T06:15:20.383ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4942024-12-21T06:15:20.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4952024-12-21T06:15:20.411ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.126437ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4962024-12-21T06:15:21.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 330de9d5-62e0-4c2d-b7bf-f879dcfad5ed roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4972024-12-21T06:15:21.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 330de9d5-62e0-4c2d-b7bf-f879dcfad5ed resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4982024-12-21T06:15:21.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 330de9d5-62e0-4c2d-b7bf-f879dcfad5ed response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
4992024-12-21T06:15:22.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cadf8199-9bd2-4cdd-9c4b-3a43a37d6f35 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5002024-12-21T06:15:22.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cadf8199-9bd2-4cdd-9c4b-3a43a37d6f35 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5012024-12-21T06:15:22.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cadf8199-9bd2-4cdd-9c4b-3a43a37d6f35 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5022024-12-21T06:15:23.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a54a1a00-8e88-446b-b319-fc9d3ae21c99 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5032024-12-21T06:15:23.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a54a1a00-8e88-446b-b319-fc9d3ae21c99 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5042024-12-21T06:15:23.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a54a1a00-8e88-446b-b319-fc9d3ae21c99 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5052024-12-21T06:15:23.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1430 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 4114cdbb-d2f2-4423-8054-3c5d12a768af response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
5062024-12-21T06:15:24.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 58eb91bd-75de-4e51-94d7-6fd685792379 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5072024-12-21T06:15:24.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 58eb91bd-75de-4e51-94d7-6fd685792379 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5082024-12-21T06:15:24.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 58eb91bd-75de-4e51-94d7-6fd685792379 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5092024-12-21T06:15:25.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 408d0dad-c4c9-4d3f-b3fe-f4f860d51e29 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5102024-12-21T06:15:25.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 408d0dad-c4c9-4d3f-b3fe-f4f860d51e29 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5112024-12-21T06:15:25.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 408d0dad-c4c9-4d3f-b3fe-f4f860d51e29 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5122024-12-21T06:15:26.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2f7cc345-15d9-4a91-a030-dc5809ef2d10 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5132024-12-21T06:15:26.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2f7cc345-15d9-4a91-a030-dc5809ef2d10 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5142024-12-21T06:15:26.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2f7cc345-15d9-4a91-a030-dc5809ef2d10 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5152024-12-21T06:15:27.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d18f63d9-02c6-4363-a8e0-4092880cb473 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5162024-12-21T06:15:27.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d18f63d9-02c6-4363-a8e0-4092880cb473 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5172024-12-21T06:15:27.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d18f63d9-02c6-4363-a8e0-4092880cb473 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5182024-12-21T06:15:28.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5dc72f9b-91b1-43b8-9449-1f5cea5afba4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5192024-12-21T06:15:28.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5dc72f9b-91b1-43b8-9449-1f5cea5afba4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5202024-12-21T06:15:28.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5dc72f9b-91b1-43b8-9449-1f5cea5afba4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5212024-12-21T06:15:28.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = 3ea93374-1f4c-4eb1-b972-3a0c9f7a23da roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
5222024-12-21T06:15:28.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = 3ea93374-1f4c-4eb1-b972-3a0c9f7a23da resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
5232024-12-21T06:15:28.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = 3ea93374-1f4c-4eb1-b972-3a0c9f7a23da response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
5242024-12-21T06:15:28.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = ac55cdb6-c905-47ba-b75d-82805b7b2b0a roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
5252024-12-21T06:15:28.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = ac55cdb6-c905-47ba-b75d-82805b7b2b0a resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
5262024-12-21T06:15:28.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = ac55cdb6-c905-47ba-b75d-82805b7b2b0a response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
5272024-12-21T06:15:29.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9c7c3356-0017-4aea-a10e-8ed3844bc79e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5282024-12-21T06:15:29.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9c7c3356-0017-4aea-a10e-8ed3844bc79e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5292024-12-21T06:15:29.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9c7c3356-0017-4aea-a10e-8ed3844bc79e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5302024-12-21T06:15:30.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 45165383-fc5b-4a7a-afa4-81d3d332695b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5312024-12-21T06:15:30.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 45165383-fc5b-4a7a-afa4-81d3d332695b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5322024-12-21T06:15:30.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 45165383-fc5b-4a7a-afa4-81d3d332695b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
5332024-12-21T06:15:30.350ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
5342024-12-21T06:15:30.350ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
5352024-12-21T06:15:30.350ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
5362024-12-21T06:15:30.350ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5372024-12-21T06:15:30.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
5382024-12-21T06:15:30.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5392024-12-21T06:15:30.350ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
5402024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5412024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5422024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5432024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
5442024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
5452024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5462024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
5472024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5482024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5492024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5502024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
5512024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5522024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
5532024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5542024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
5552024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
5562024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5572024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5582024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
5592024-12-21T06:15:30.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5602024-12-21T06:15:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5612024-12-21T06:15:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5622024-12-21T06:15:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5632024-12-21T06:15:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5642024-12-21T06:15:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5652024-12-21T06:15:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5662024-12-21T06:15:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5672024-12-21T06:15:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5682024-12-21T06:15:30.353ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.588782ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5692024-12-21T06:15:30.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5702024-12-21T06:15:30.354ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5712024-12-21T06:15:30.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1061, tv_nsec: 439148846 } })
5722024-12-21T06:15:30.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1061, tv_nsec: 439237329 } })
5732024-12-21T06:15:30.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
5742024-12-21T06:15:30.355ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5752024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5762024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5772024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5782024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5792024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5802024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5812024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
5822024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5832024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
5842024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5852024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
5862024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
5872024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5882024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5892024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
5902024-12-21T06:15:30.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
5912024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5922024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5932024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5942024-12-21T06:15:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5952024-12-21T06:15:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5962024-12-21T06:15:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5972024-12-21T06:15:30.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5982024-12-21T06:15:30.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5992024-12-21T06:15:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6002024-12-21T06:15:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6012024-12-21T06:15:30.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6022024-12-21T06:15:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6032024-12-21T06:15:30.366ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1061, tv_nsec: 451312374 } })
6042024-12-21T06:15:30.367ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
6052024-12-21T06:15:30.402ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6062024-12-21T06:15:30.402ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6072024-12-21T06:15:30.402ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6082024-12-21T06:15:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6092024-12-21T06:15:30.404ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6102024-12-21T06:15:30.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6112024-12-21T06:15:30.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6122024-12-21T06:15:30.405ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6132024-12-21T06:15:30.406ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.655197ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
6142024-12-21T06:15:30.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6152024-12-21T06:15:30.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6162024-12-21T06:15:30.406ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6172024-12-21T06:15:30.406ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6182024-12-21T06:15:30.406ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6192024-12-21T06:15:30.406ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6202024-12-21T06:15:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6212024-12-21T06:15:30.407ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6222024-12-21T06:15:30.407ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6232024-12-21T06:15:30.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6242024-12-21T06:15:30.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6252024-12-21T06:15:30.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6262024-12-21T06:15:30.409ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.905117ms iteration = 4 status = {"errors":[],"finish_invoked_ok":[]}
6272024-12-21T06:15:30.409ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6282024-12-21T06:15:30.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6292024-12-21T06:15:30.410ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6302024-12-21T06:15:30.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
6312024-12-21T06:15:30.410ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6322024-12-21T06:15:30.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6332024-12-21T06:15:30.410ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6342024-12-21T06:15:30.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6352024-12-21T06:15:30.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6362024-12-21T06:15:30.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6372024-12-21T06:15:30.412ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6382024-12-21T06:15:30.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6392024-12-21T06:15:30.414ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 57.960688ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6402024-12-21T06:15:30.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6412024-12-21T06:15:30.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6422024-12-21T06:15:30.416ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6432024-12-21T06:15:30.416ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.238389ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6442024-12-21T06:15:30.417ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6452024-12-21T06:15:30.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6462024-12-21T06:15:30.426ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
6472024-12-21T06:15:30.426ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.581636ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
6482024-12-21T06:15:30.426ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6492024-12-21T06:15:30.426ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6502024-12-21T06:15:30.427ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "306337f3-138b-4232-b02e-a5f1f0da9c34", "content-length": "26", "date": "Sat, 21 Dec 2024 06:15:30 GMT"} })
6512024-12-21T06:15:30.427ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6522024-12-21T06:15:30.428ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6532024-12-21T06:15:30.434ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.601451ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6542024-12-21T06:15:30.441ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6552024-12-21T06:15:30.441ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6562024-12-21T06:15:30.441ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb735104-81e7-4502-af0e-f1061d8b63c8", "content-length": "26", "date": "Sat, 21 Dec 2024 06:15:30 GMT"} })
6572024-12-21T06:15:30.441ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6582024-12-21T06:15:30.443ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6592024-12-21T06:15:30.444ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6602024-12-21T06:15:30.444ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
6612024-12-21T06:15:30.444ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.914447ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
6622024-12-21T06:15:30.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6632024-12-21T06:15:30.448ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6642024-12-21T06:15:30.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6652024-12-21T06:15:30.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6662024-12-21T06:15:30.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6672024-12-21T06:15:30.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6682024-12-21T06:15:30.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.678457ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6692024-12-21T06:15:30.454ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
6702024-12-21T06:15:30.454ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6712024-12-21T06:15:30.454ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5bba0db-4b45-4ef2-8192-4c07f2151fbb", "content-length": "26", "date": "Sat, 21 Dec 2024 06:15:30 GMT"} })
6722024-12-21T06:15:30.454ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6732024-12-21T06:15:30.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6742024-12-21T06:15:30.456ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
6752024-12-21T06:15:30.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6762024-12-21T06:15:30.457ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6772024-12-21T06:15:30.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6782024-12-21T06:15:30.479ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 123.263819ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
6792024-12-21T06:15:30.508ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6802024-12-21T06:15:30.508ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "45064fee-4ed0-426c-a7eb-ef23eee006fc", "content-length": "1", "date": "Sat, 21 Dec 2024 06:15:30 GMT"} })
6812024-12-21T06:15:30.510ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6822024-12-21T06:15:30.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6832024-12-21T06:15:30.512ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 161.644004ms iteration = 4 status = null
6842024-12-21T06:15:30.534ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 184.327282ms iteration = 4 status = {}
6852024-12-21T06:15:30.550ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6862024-12-21T06:15:30.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6872024-12-21T06:15:30.552ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6882024-12-21T06:15:30.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6892024-12-21T06:15:30.554ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6902024-12-21T06:15:30.556ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
6912024-12-21T06:15:30.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6922024-12-21T06:15:30.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6932024-12-21T06:15:30.558ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 206.514198ms iteration = 7 status = {"physical_disks_added":0}
6942024-12-21T06:15:30.583ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
6952024-12-21T06:15:30.583ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
6962024-12-21T06:15:30.583ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fdef135-9678-47a4-b321-8f8b37ec6260", "content-length": "372", "date": "Sat, 21 Dec 2024 06:15:30 GMT"} })
6972024-12-21T06:15:30.583ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6982024-12-21T06:15:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6992024-12-21T06:15:30.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7002024-12-21T06:15:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7012024-12-21T06:15:30.584ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 233.077935ms iteration = 4 status = 0
7022024-12-21T06:15:30.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7032024-12-21T06:15:30.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7042024-12-21T06:15:30.628ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
7052024-12-21T06:15:30.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7062024-12-21T06:15:30.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7072024-12-21T06:15:30.638ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
7082024-12-21T06:15:30.638ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "992a807f-ec4c-47e5-865a-41041ac9e00d", "content-length": "134", "date": "Sat, 21 Dec 2024 06:15:30 GMT"} })
7092024-12-21T06:15:30.638ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
7102024-12-21T06:15:30.638ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
7112024-12-21T06:15:30.639ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
7122024-12-21T06:15:30.639ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
7132024-12-21T06:15:30.639ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7142024-12-21T06:15:30.639ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7152024-12-21T06:15:30.639ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7162024-12-21T06:15:30.639ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7172024-12-21T06:15:30.639ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
7182024-12-21T06:15:30.639ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
7192024-12-21T06:15:30.639ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
7202024-12-21T06:15:30.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7212024-12-21T06:15:30.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7222024-12-21T06:15:30.651ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
7232024-12-21T06:15:30.651ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2a575c1-b80a-4564-8b2b-af856aa556e6", "content-length": "2", "date": "Sat, 21 Dec 2024 06:15:30 GMT"} })
7242024-12-21T06:15:30.651ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
7252024-12-21T06:15:30.651ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "aab7577d-4e13-4ac1-97f0-21d101ccca27", "content-length": "52", "date": "Sat, 21 Dec 2024 06:15:30 GMT"} })
7262024-12-21T06:15:30.651ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
7272024-12-21T06:15:30.651ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
7282024-12-21T06:15:30.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7292024-12-21T06:15:30.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7302024-12-21T06:15:30.709ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7312024-12-21T06:15:30.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7322024-12-21T06:15:30.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7332024-12-21T06:15:30.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7342024-12-21T06:15:30.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7352024-12-21T06:15:30.716ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7362024-12-21T06:15:30.716ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7372024-12-21T06:15:30.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7382024-12-21T06:15:30.740ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
7392024-12-21T06:15:30.740ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
7402024-12-21T06:15:30.747ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ed6883c2-c2ae-4188-812d-b069d49d21c0", "date": "Sat, 21 Dec 2024 06:15:30 GMT"} })
7412024-12-21T06:15:30.747ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
7422024-12-21T06:15:30.747ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
7432024-12-21T06:15:30.747ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "99c6b5f3-eb17-4100-af9d-864b67981b72", "date": "Sat, 21 Dec 2024 06:15:30 GMT"} })
7442024-12-21T06:15:30.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7452024-12-21T06:15:30.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7462024-12-21T06:15:30.747ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b4c2bec-03dd-44a1-ad5c-432f7009c4de", "content-length": "682", "date": "Sat, 21 Dec 2024 06:15:30 GMT"} })
7472024-12-21T06:15:30.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7482024-12-21T06:15:30.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7492024-12-21T06:15:30.750ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7502024-12-21T06:15:30.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7512024-12-21T06:15:30.751ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7522024-12-21T06:15:30.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7532024-12-21T06:15:30.753ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7542024-12-21T06:15:30.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7552024-12-21T06:15:30.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7562024-12-21T06:15:30.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7572024-12-21T06:15:30.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7582024-12-21T06:15:30.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7592024-12-21T06:15:30.760ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
7602024-12-21T06:15:30.760ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7612024-12-21T06:15:30.760ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ff417a72-c71a-4988-8d5f-069a0833b726", "date": "Sat, 21 Dec 2024 06:15:30 GMT"} })
7622024-12-21T06:15:30.762ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 405.571188ms iteration = 5 status = {}
7632024-12-21T06:15:30.765ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 413.19644ms iteration = 4 status = {}
7642024-12-21T06:15:30.806ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
7652024-12-21T06:15:30.806ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e638b77d-2fa2-4514-b4fd-7867b46efd50", "content-length": "691", "date": "Sat, 21 Dec 2024 06:15:30 GMT"} })
7662024-12-21T06:15:30.806ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
7672024-12-21T06:15:30.806ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
7682024-12-21T06:15:30.806ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
7692024-12-21T06:15:30.808ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 456.717587ms iteration = 4 status = {}
7702024-12-21T06:15:31.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eef86f83-f0f3-4c5a-bfb2-a227b29e0f28 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7712024-12-21T06:15:31.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eef86f83-f0f3-4c5a-bfb2-a227b29e0f28 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7722024-12-21T06:15:31.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eef86f83-f0f3-4c5a-bfb2-a227b29e0f28 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7732024-12-21T06:15:31.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 88df339c-05fc-462e-9bc9-b8c6e48d6e42 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
7742024-12-21T06:15:31.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 88df339c-05fc-462e-9bc9-b8c6e48d6e42 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
7752024-12-21T06:15:31.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 88df339c-05fc-462e-9bc9-b8c6e48d6e42 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
7762024-12-21T06:15:32.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4694a0f3-f485-43e8-bf91-bae5b9f9acce roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7772024-12-21T06:15:32.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4694a0f3-f485-43e8-bf91-bae5b9f9acce resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7782024-12-21T06:15:32.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4694a0f3-f485-43e8-bf91-bae5b9f9acce response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7792024-12-21T06:15:33.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1eb43b9f-d7ec-42bd-9aa1-350497fa7d3d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7802024-12-21T06:15:33.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1eb43b9f-d7ec-42bd-9aa1-350497fa7d3d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7812024-12-21T06:15:33.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1eb43b9f-d7ec-42bd-9aa1-350497fa7d3d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7822024-12-21T06:15:33.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1772 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = bef703ad-4ffb-4d49-9e2c-0413fa380f80 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
7832024-12-21T06:15:34.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0dac48ed-017c-4479-a2df-13acec23f749 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7842024-12-21T06:15:34.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0dac48ed-017c-4479-a2df-13acec23f749 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7852024-12-21T06:15:34.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2643 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0dac48ed-017c-4479-a2df-13acec23f749 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7862024-12-21T06:15:35.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7a83b299-f1de-4c6a-92bb-90320fd9a4c2 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7872024-12-21T06:15:35.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7a83b299-f1de-4c6a-92bb-90320fd9a4c2 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7882024-12-21T06:15:35.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7a83b299-f1de-4c6a-92bb-90320fd9a4c2 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7892024-12-21T06:15:36.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6f117a58-3315-47fb-b44f-76f37a05fd95 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7902024-12-21T06:15:36.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6f117a58-3315-47fb-b44f-76f37a05fd95 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7912024-12-21T06:15:36.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2808 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6f117a58-3315-47fb-b44f-76f37a05fd95 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7922024-12-21T06:15:37.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9c29a402-18c5-4a58-b79b-e02e81ae0319 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7932024-12-21T06:15:37.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9c29a402-18c5-4a58-b79b-e02e81ae0319 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7942024-12-21T06:15:37.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9c29a402-18c5-4a58-b79b-e02e81ae0319 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7952024-12-21T06:15:38.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7d9f698b-f583-4937-ac31-7bc60eb56b55 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7962024-12-21T06:15:38.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7d9f698b-f583-4937-ac31-7bc60eb56b55 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7972024-12-21T06:15:38.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7d9f698b-f583-4937-ac31-7bc60eb56b55 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7982024-12-21T06:15:39.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 85e243a6-0f40-4d35-8229-e9a35b3ec2e1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
7992024-12-21T06:15:39.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 85e243a6-0f40-4d35-8229-e9a35b3ec2e1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8002024-12-21T06:15:39.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 85e243a6-0f40-4d35-8229-e9a35b3ec2e1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8012024-12-21T06:15:40.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
8022024-12-21T06:15:40.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8032024-12-21T06:15:40.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8042024-12-21T06:15:40.352ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
8052024-12-21T06:15:40.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8062024-12-21T06:15:40.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8072024-12-21T06:15:40.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8082024-12-21T06:15:40.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8092024-12-21T06:15:40.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8102024-12-21T06:15:40.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8112024-12-21T06:15:40.385ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8122024-12-21T06:15:40.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8132024-12-21T06:15:40.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8142024-12-21T06:15:40.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8152024-12-21T06:15:40.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8162024-12-21T06:15:40.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
8172024-12-21T06:15:40.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8182024-12-21T06:15:40.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8192024-12-21T06:15:40.402ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
8202024-12-21T06:15:40.402ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.860839ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
8212024-12-21T06:15:40.412ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.846478ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8222024-12-21T06:15:40.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13ca5a3a-268b-4170-82ca-4f4861288987 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8232024-12-21T06:15:40.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13ca5a3a-268b-4170-82ca-4f4861288987 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8242024-12-21T06:15:40.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13ca5a3a-268b-4170-82ca-4f4861288987 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8252024-12-21T06:15:41.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e867be8a-4df6-4c39-8acc-b01728259a88 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8262024-12-21T06:15:41.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e867be8a-4df6-4c39-8acc-b01728259a88 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8272024-12-21T06:15:41.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e867be8a-4df6-4c39-8acc-b01728259a88 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8282024-12-21T06:15:42.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = af2cf3a4-874c-428e-b92c-1738393cc53e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8292024-12-21T06:15:42.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = af2cf3a4-874c-428e-b92c-1738393cc53e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8302024-12-21T06:15:42.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = af2cf3a4-874c-428e-b92c-1738393cc53e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8312024-12-21T06:15:43.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a86438f6-0080-40ea-bc2a-1be0eac53fe5 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8322024-12-21T06:15:43.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a86438f6-0080-40ea-bc2a-1be0eac53fe5 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8332024-12-21T06:15:43.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a86438f6-0080-40ea-bc2a-1be0eac53fe5 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8342024-12-21T06:15:43.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = b8531600-5c61-4426-b657-c5dd94f390dd roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
8352024-12-21T06:15:43.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = b8531600-5c61-4426-b657-c5dd94f390dd resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
8362024-12-21T06:15:43.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = b8531600-5c61-4426-b657-c5dd94f390dd response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
8372024-12-21T06:15:43.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = 13da2c60-a38a-4b78-9724-67117b3cc072 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
8382024-12-21T06:15:43.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = 13da2c60-a38a-4b78-9724-67117b3cc072 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
8392024-12-21T06:15:43.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58224 req_id = 13da2c60-a38a-4b78-9724-67117b3cc072 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
8402024-12-21T06:15:43.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1320 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 481984e3-705d-466d-9e41-2f729d794071 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
8412024-12-21T06:15:44.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5d125d7b-6f5a-447e-b765-3a486697dde1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8422024-12-21T06:15:44.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5d125d7b-6f5a-447e-b765-3a486697dde1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8432024-12-21T06:15:44.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5d125d7b-6f5a-447e-b765-3a486697dde1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8442024-12-21T06:15:45.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c2842b8c-f334-44b6-972c-43c4237ee134 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8452024-12-21T06:15:45.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c2842b8c-f334-44b6-972c-43c4237ee134 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8462024-12-21T06:15:45.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c2842b8c-f334-44b6-972c-43c4237ee134 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8472024-12-21T06:15:46.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6d149fa5-0084-4940-a535-66b6969fd515 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8482024-12-21T06:15:46.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6d149fa5-0084-4940-a535-66b6969fd515 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8492024-12-21T06:15:46.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6d149fa5-0084-4940-a535-66b6969fd515 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8502024-12-21T06:15:47.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 003b9ef1-ddd6-4246-93f6-8ce6551a63a0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8512024-12-21T06:15:47.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 003b9ef1-ddd6-4246-93f6-8ce6551a63a0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8522024-12-21T06:15:47.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 003b9ef1-ddd6-4246-93f6-8ce6551a63a0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8532024-12-21T06:15:48.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4a329904-318f-4d83-af45-bee2f34f1c98 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8542024-12-21T06:15:48.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4a329904-318f-4d83-af45-bee2f34f1c98 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8552024-12-21T06:15:48.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4a329904-318f-4d83-af45-bee2f34f1c98 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8562024-12-21T06:15:49.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bd28ea1f-ec83-463a-a22e-da445a9de022 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8572024-12-21T06:15:49.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bd28ea1f-ec83-463a-a22e-da445a9de022 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8582024-12-21T06:15:49.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bd28ea1f-ec83-463a-a22e-da445a9de022 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8592024-12-21T06:15:50.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
8602024-12-21T06:15:50.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8612024-12-21T06:15:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8622024-12-21T06:15:50.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
8632024-12-21T06:15:50.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8642024-12-21T06:15:50.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8652024-12-21T06:15:50.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8662024-12-21T06:15:50.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8672024-12-21T06:15:50.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8682024-12-21T06:15:50.380ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8692024-12-21T06:15:50.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8702024-12-21T06:15:50.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8712024-12-21T06:15:50.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8722024-12-21T06:15:50.382ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.307468ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
8732024-12-21T06:15:50.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8742024-12-21T06:15:50.412ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8752024-12-21T06:15:50.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
8762024-12-21T06:15:50.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8772024-12-21T06:15:50.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8782024-12-21T06:15:50.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
8792024-12-21T06:15:50.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 181.492453ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
8802024-12-21T06:15:50.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 931eecec-7654-4554-95d3-edc30a49629a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8812024-12-21T06:15:50.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 931eecec-7654-4554-95d3-edc30a49629a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8822024-12-21T06:15:50.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 931eecec-7654-4554-95d3-edc30a49629a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8832024-12-21T06:15:51.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 35cede15-bde8-4094-8f07-fb12573fa22b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8842024-12-21T06:15:51.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 35cede15-bde8-4094-8f07-fb12573fa22b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8852024-12-21T06:15:51.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 35cede15-bde8-4094-8f07-fb12573fa22b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8862024-12-21T06:15:52.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ec752423-263b-4bca-ba31-e0869cbce638 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8872024-12-21T06:15:52.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ec752423-263b-4bca-ba31-e0869cbce638 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8882024-12-21T06:15:52.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ec752423-263b-4bca-ba31-e0869cbce638 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8892024-12-21T06:15:53.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 14b81baa-7b5d-4240-8d63-d6d711b053dd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8902024-12-21T06:15:53.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 14b81baa-7b5d-4240-8d63-d6d711b053dd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8912024-12-21T06:15:53.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 14b81baa-7b5d-4240-8d63-d6d711b053dd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8922024-12-21T06:15:53.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1443 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 500ed4eb-4d0c-4b06-8852-fecc14fc1eb7 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
8932024-12-21T06:15:54.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ebb79ae4-3ac9-4301-8524-625f12ccd7cc roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8942024-12-21T06:15:54.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ebb79ae4-3ac9-4301-8524-625f12ccd7cc resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8952024-12-21T06:15:54.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ebb79ae4-3ac9-4301-8524-625f12ccd7cc response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8962024-12-21T06:15:55.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26fcddb8-6844-426b-9f36-9554e65dc88b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8972024-12-21T06:15:55.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26fcddb8-6844-426b-9f36-9554e65dc88b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8982024-12-21T06:15:55.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26fcddb8-6844-426b-9f36-9554e65dc88b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
8992024-12-21T06:15:56.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e3f437e9-c51d-4731-b6d4-9b44dd095286 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
9002024-12-21T06:15:56.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e3f437e9-c51d-4731-b6d4-9b44dd095286 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
9012024-12-21T06:15:56.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1923 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e3f437e9-c51d-4731-b6d4-9b44dd095286 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
9022024-12-21T06:15:57.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7e73385-9a4e-4bd4-988f-cb8cb88a2202 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
9032024-12-21T06:15:57.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7e73385-9a4e-4bd4-988f-cb8cb88a2202 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
9042024-12-21T06:15:57.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7e73385-9a4e-4bd4-988f-cb8cb88a2202 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
9052024-12-21T06:15:58.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 239bc704-5b21-4524-94e7-f1ecd829f149 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
9062024-12-21T06:15:58.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 239bc704-5b21-4524-94e7-f1ecd829f149 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
9072024-12-21T06:15:58.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 239bc704-5b21-4524-94e7-f1ecd829f149 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
9082024-12-21T06:15:59.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 06352366-d17a-4840-bfe8-5bbf1f93de94 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
9092024-12-21T06:15:59.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 06352366-d17a-4840-bfe8-5bbf1f93de94 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
9102024-12-21T06:15:59.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 06352366-d17a-4840-bfe8-5bbf1f93de94 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
9112024-12-21T06:16:00.350ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
9122024-12-21T06:16:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
9132024-12-21T06:16:00.350ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
9142024-12-21T06:16:00.350ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
9152024-12-21T06:16:00.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
9162024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9172024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9182024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
9192024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
9202024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
9212024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
9222024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
9232024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
9242024-12-21T06:16:00.351ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 06:06:00.351018109 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
9252024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
9262024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
9272024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9282024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
9292024-12-21T06:16:00.351ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 7c419228-2431-4394-af83-ea0457364b70
9302024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
9312024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.79\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"7c419228-2431-4394-af83-ea0457364b70"}
9322024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
9332024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
9342024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
9352024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9362024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
9372024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9382024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
9392024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
9402024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9412024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9422024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
9432024-12-21T06:16:00.351ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
9442024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
9452024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
9462024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
9472024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
9482024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9492024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
9502024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9512024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
9522024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
9532024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9542024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
9552024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9562024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
9572024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9582024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
9592024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9602024-12-21T06:16:00.351ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("068965c6-3480-4953-b57e-dd969abb2a21.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("45c0a855-5592-491c-b7b3-470902319db2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1091, tv_nsec: 436106112 } })
9612024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9622024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9632024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
9642024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9652024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9662024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
9672024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9682024-12-21T06:16:00.351ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1091, tv_nsec: 436270537 } })
9692024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9702024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9712024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9722024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
9732024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9742024-12-21T06:16:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
9752024-12-21T06:16:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9762024-12-21T06:16:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9772024-12-21T06:16:00.352ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
9782024-12-21T06:16:00.352ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.382248ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
9792024-12-21T06:16:00.352ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
9802024-12-21T06:16:00.352ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.413099ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
9812024-12-21T06:16:00.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9822024-12-21T06:16:00.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1091, tv_nsec: 437992905 } })
9832024-12-21T06:16:00.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9842024-12-21T06:16:00.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
9852024-12-21T06:16:00.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9862024-12-21T06:16:00.354ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9872024-12-21T06:16:00.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9882024-12-21T06:16:00.355ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 06:06:00.351018109 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
9892024-12-21T06:16:00.355ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.760972ms iteration = 3 status = {"expiration":"2024-12-21T06:06:00.351018109Z","pruned":[]}
9902024-12-21T06:16:00.355ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.868465ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
9912024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
9922024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
9932024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9942024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
9952024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
9962024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
9972024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
9982024-12-21T06:16:00.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
9992024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10002024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
10012024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10022024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
10032024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10042024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
10052024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10062024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10072024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
10082024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10092024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
10102024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10112024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10122024-12-21T06:16:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10132024-12-21T06:16:00.357ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10142024-12-21T06:16:00.357ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10152024-12-21T06:16:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10162024-12-21T06:16:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10172024-12-21T06:16:00.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10182024-12-21T06:16:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10192024-12-21T06:16:00.358ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10202024-12-21T06:16:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10212024-12-21T06:16:00.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10222024-12-21T06:16:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10232024-12-21T06:16:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10242024-12-21T06:16:00.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10252024-12-21T06:16:00.360ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10262024-12-21T06:16:00.360ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1091, tv_nsec: 445309327 } })
10272024-12-21T06:16:00.361ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10282024-12-21T06:16:00.361ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
10292024-12-21T06:16:00.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10302024-12-21T06:16:00.362ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10312024-12-21T06:16:00.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10322024-12-21T06:16:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10332024-12-21T06:16:00.363ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10342024-12-21T06:16:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10352024-12-21T06:16:00.364ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10362024-12-21T06:16:00.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10372024-12-21T06:16:00.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10382024-12-21T06:16:00.364ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10392024-12-21T06:16:00.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10402024-12-21T06:16:00.366ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10412024-12-21T06:16:00.366ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.668506ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
10422024-12-21T06:16:00.366ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10432024-12-21T06:16:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10442024-12-21T06:16:00.368ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.27566ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
10452024-12-21T06:16:00.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
10462024-12-21T06:16:00.371ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.272404ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
10472024-12-21T06:16:00.372ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10482024-12-21T06:16:00.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10492024-12-21T06:16:00.372ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10502024-12-21T06:16:00.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10512024-12-21T06:16:00.374ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1091, tv_nsec: 458789551 } })
10522024-12-21T06:16:00.374ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
10532024-12-21T06:16:00.374ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10542024-12-21T06:16:00.374ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 23.649856ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10552024-12-21T06:16:00.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10562024-12-21T06:16:00.375ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10572024-12-21T06:16:00.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10582024-12-21T06:16:00.381ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10592024-12-21T06:16:00.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10602024-12-21T06:16:00.384ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10612024-12-21T06:16:00.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10622024-12-21T06:16:00.401ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10632024-12-21T06:16:00.401ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
10642024-12-21T06:16:00.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10652024-12-21T06:16:00.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10662024-12-21T06:16:00.404ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10672024-12-21T06:16:00.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 55.821008ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10682024-12-21T06:16:00.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
10692024-12-21T06:16:00.407ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10702024-12-21T06:16:00.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10712024-12-21T06:16:00.410ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
10722024-12-21T06:16:00.410ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
10732024-12-21T06:16:00.410ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
10742024-12-21T06:16:00.410ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10752024-12-21T06:16:00.410ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10762024-12-21T06:16:00.410ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
10772024-12-21T06:16:00.410ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
10782024-12-21T06:16:00.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10792024-12-21T06:16:00.410ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 54.728178ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
10802024-12-21T06:16:00.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10812024-12-21T06:16:00.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
10822024-12-21T06:16:00.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10832024-12-21T06:16:00.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10842024-12-21T06:16:00.414ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10852024-12-21T06:16:00.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10862024-12-21T06:16:00.416ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10872024-12-21T06:16:00.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10882024-12-21T06:16:00.416ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10892024-12-21T06:16:00.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10902024-12-21T06:16:00.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10912024-12-21T06:16:00.418ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10922024-12-21T06:16:00.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10932024-12-21T06:16:00.419ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10942024-12-21T06:16:00.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10952024-12-21T06:16:00.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10962024-12-21T06:16:00.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10972024-12-21T06:16:00.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
10982024-12-21T06:16:00.423ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10992024-12-21T06:16:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11002024-12-21T06:16:00.424ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11012024-12-21T06:16:00.424ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.990484ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11022024-12-21T06:16:00.425ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11032024-12-21T06:16:00.425ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11042024-12-21T06:16:00.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11052024-12-21T06:16:00.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 69.189288ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11062024-12-21T06:16:00.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11072024-12-21T06:16:00.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11082024-12-21T06:16:00.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11092024-12-21T06:16:00.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11102024-12-21T06:16:00.437ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.476178ms iteration = 8 status = {"physical_disks_added":0}
11112024-12-21T06:16:00.439ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11122024-12-21T06:16:00.439ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11132024-12-21T06:16:00.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11142024-12-21T06:16:00.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11152024-12-21T06:16:00.442ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11162024-12-21T06:16:00.442ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11172024-12-21T06:16:00.442ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 91.065085ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11182024-12-21T06:16:00.442ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
11192024-12-21T06:16:00.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
11202024-12-21T06:16:00.456ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
11212024-12-21T06:16:00.456ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
11222024-12-21T06:16:00.456ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 105.419464ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
11232024-12-21T06:16:00.460ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 103.971094ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
11242024-12-21T06:16:00.463ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11252024-12-21T06:16:00.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11262024-12-21T06:16:00.466ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11272024-12-21T06:16:00.468ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
11282024-12-21T06:16:00.468ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
11292024-12-21T06:16:00.468ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
11302024-12-21T06:16:00.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11312024-12-21T06:16:00.468ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11322024-12-21T06:16:00.468ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11332024-12-21T06:16:00.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11342024-12-21T06:16:00.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11352024-12-21T06:16:00.470ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
11362024-12-21T06:16:00.470ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
11372024-12-21T06:16:00.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11382024-12-21T06:16:00.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11392024-12-21T06:16:00.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11402024-12-21T06:16:00.472ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11412024-12-21T06:16:00.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11422024-12-21T06:16:00.474ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11432024-12-21T06:16:00.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11442024-12-21T06:16:00.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11452024-12-21T06:16:00.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11462024-12-21T06:16:00.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11472024-12-21T06:16:00.478ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
11482024-12-21T06:16:00.478ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
11492024-12-21T06:16:00.478ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 06:14:07.931887 UTC dns_group = internal generation = 1
11502024-12-21T06:16:00.478ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 127.140546ms iteration = 4 status = {"generation":1}
11512024-12-21T06:16:00.478ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
11522024-12-21T06:16:00.492ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11532024-12-21T06:16:00.493ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11542024-12-21T06:16:00.493ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5da031c-246f-4ec7-99a5-b7e15590fb9e", "content-length": "26", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} })
11552024-12-21T06:16:00.493ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11562024-12-21T06:16:00.494ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11572024-12-21T06:16:00.497ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
11582024-12-21T06:16:00.500ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11592024-12-21T06:16:00.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11602024-12-21T06:16:00.506ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
11612024-12-21T06:16:00.506ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 0 version = 2
11622024-12-21T06:16:00.506ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11632024-12-21T06:16:00.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11642024-12-21T06:16:00.507ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11652024-12-21T06:16:00.507ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11662024-12-21T06:16:00.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11672024-12-21T06:16:00.507ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b6b4c02-7763-42d9-a8c6-bde4be5eb8c9", "content-length": "26", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} })
11682024-12-21T06:16:00.507ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11692024-12-21T06:16:00.508ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11702024-12-21T06:16:00.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11712024-12-21T06:16:00.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11722024-12-21T06:16:00.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11732024-12-21T06:16:00.517ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T06:13:58.796551Z, time_modified: 2024-12-21T06:13:58.796551Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
11742024-12-21T06:16:00.517ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 166.057186ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]}},"default_endpoint":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
11752024-12-21T06:16:00.524ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
11762024-12-21T06:16:00.524ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11772024-12-21T06:16:00.524ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1e28caaa-0793-4bca-8032-f0f830a9265a", "content-length": "26", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} })
11782024-12-21T06:16:00.524ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11792024-12-21T06:16:00.527ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
11802024-12-21T06:16:00.543ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
11812024-12-21T06:16:00.543ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 192.118289ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
11822024-12-21T06:16:00.549ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
11832024-12-21T06:16:00.549ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 198.643069ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
11842024-12-21T06:16:00.573ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11852024-12-21T06:16:00.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11862024-12-21T06:16:00.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11872024-12-21T06:16:00.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11882024-12-21T06:16:00.625ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
11892024-12-21T06:16:00.625ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f3b416a3-4b48-49bf-8ca8-413aebed3018", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11902024-12-21T06:16:00.625ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11912024-12-21T06:16:00.626ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d752084f-a82d-4589-98e2-837aff61484b", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11922024-12-21T06:16:00.626ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11932024-12-21T06:16:00.628ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
11942024-12-21T06:16:00.628ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 277.335201ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
11952024-12-21T06:16:00.663ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11962024-12-21T06:16:00.664ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "984beab1-1ce1-45f4-a9c5-1b085dcb03cf", "content-length": "1", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} })
11972024-12-21T06:16:00.664ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11982024-12-21T06:16:00.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11992024-12-21T06:16:00.665ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
12002024-12-21T06:16:00.673ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 322.569537ms iteration = 5 status = {}
12012024-12-21T06:16:00.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 22f699a4-c764-4a88-8467-a89ace1db7cb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
12022024-12-21T06:16:00.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 22f699a4-c764-4a88-8467-a89ace1db7cb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
12032024-12-21T06:16:00.738ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12042024-12-21T06:16:00.738ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12052024-12-21T06:16:00.739ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5884a9bb-3e8b-4101-ab17-b94a85c4b558", "content-length": "372", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} })
12062024-12-21T06:16:00.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12072024-12-21T06:16:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12082024-12-21T06:16:00.740ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 1 version = 2
12092024-12-21T06:16:00.740ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
12102024-12-21T06:16:00.740ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 06:14:08.776888 UTC dns_group = external generation = 2
12112024-12-21T06:16:00.740ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 389.789181ms iteration = 4 status = {"generation":2}
12122024-12-21T06:16:00.741ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12132024-12-21T06:16:00.741ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 390.672155ms iteration = 5 status = null
12142024-12-21T06:16:00.741ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12152024-12-21T06:16:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12162024-12-21T06:16:00.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 22f699a4-c764-4a88-8467-a89ace1db7cb response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
12172024-12-21T06:16:00.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12182024-12-21T06:16:00.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12192024-12-21T06:16:00.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12202024-12-21T06:16:00.744ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12212024-12-21T06:16:00.744ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12222024-12-21T06:16:00.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12232024-12-21T06:16:00.747ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12242024-12-21T06:16:00.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12252024-12-21T06:16:00.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
12262024-12-21T06:16:00.748ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12272024-12-21T06:16:00.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12282024-12-21T06:16:00.749ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
12292024-12-21T06:16:00.749ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "60d0a08e-bbc3-45f4-9d6c-79d6d4fe4d4a", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
12302024-12-21T06:16:00.749ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
12312024-12-21T06:16:00.750ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b011e5de-53cc-495d-b975-9cba88eb94ba", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
12322024-12-21T06:16:00.750ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
12332024-12-21T06:16:00.750ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 399.560942ms iteration = 5 status = 0
12342024-12-21T06:16:00.752ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d75279b4-8660-498c-beee-2d1ed1bf36ab", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
12352024-12-21T06:16:00.752ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
12362024-12-21T06:16:00.753ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
12372024-12-21T06:16:00.753ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 402.920735ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
12382024-12-21T06:16:00.758ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
12392024-12-21T06:16:00.758ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12402024-12-21T06:16:00.759ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e03be1bd-8945-4407-857d-cd136e64db22", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} })
12412024-12-21T06:16:00.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12422024-12-21T06:16:00.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12432024-12-21T06:16:00.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12442024-12-21T06:16:00.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12452024-12-21T06:16:00.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12462024-12-21T06:16:00.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12472024-12-21T06:16:00.768ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12482024-12-21T06:16:00.768ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12492024-12-21T06:16:00.769ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2a6eb33a-562b-48ae-9b44-7ef06902a3ff", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} })
12502024-12-21T06:16:00.770ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 414.177317ms iteration = 6 status = {}
12512024-12-21T06:16:00.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12522024-12-21T06:16:00.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12532024-12-21T06:16:00.849ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12542024-12-21T06:16:00.849ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d75df464-055d-4090-af33-c155db29ea6e", "content-length": "691", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} })
12552024-12-21T06:16:00.849ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
12562024-12-21T06:16:00.849ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
12572024-12-21T06:16:00.849ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
12582024-12-21T06:16:00.850ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 499.249677ms iteration = 5 status = {}
12592024-12-21T06:16:00.850ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
12602024-12-21T06:16:00.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12612024-12-21T06:16:00.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12622024-12-21T06:16:00.859ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
12632024-12-21T06:16:00.859ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "556bd8d5-590e-4bd4-917b-3ad74e08a998", "content-length": "134", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} })
12642024-12-21T06:16:00.859ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
12652024-12-21T06:16:00.859ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
12662024-12-21T06:16:00.860ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
12672024-12-21T06:16:00.860ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12682024-12-21T06:16:00.860ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12692024-12-21T06:16:00.860ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12702024-12-21T06:16:00.860ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12712024-12-21T06:16:00.860ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12722024-12-21T06:16:00.860ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12732024-12-21T06:16:00.860ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12742024-12-21T06:16:00.860ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
12752024-12-21T06:16:00.860ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12762024-12-21T06:16:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12772024-12-21T06:16:00.863ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12782024-12-21T06:16:00.863ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a43cb60-1410-4f03-804d-6bab35f5f5e7", "content-length": "2", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} })
12792024-12-21T06:16:00.863ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
12802024-12-21T06:16:00.863ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef67b05f-53d4-49ab-b39f-1f5997e480bc", "content-length": "52", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} })
12812024-12-21T06:16:00.863ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
12822024-12-21T06:16:00.863ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
12832024-12-21T06:16:00.952ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "444e2499-284d-43f6-a79e-81ea1ff51062", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} })
12842024-12-21T06:16:00.952ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
12852024-12-21T06:16:00.952ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
12862024-12-21T06:16:00.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d8b213c4-0a64-4294-a181-e8f3535e7b56 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
12872024-12-21T06:16:00.952ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d8b213c4-0a64-4294-a181-e8f3535e7b56 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
12882024-12-21T06:16:00.953ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d325825-39d9-498c-b2a4-c3bc9a75dc03", "content-length": "682", "date": "Sat, 21 Dec 2024 06:16:00 GMT"} })
12892024-12-21T06:16:00.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12902024-12-21T06:16:00.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12912024-12-21T06:16:00.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d8b213c4-0a64-4294-a181-e8f3535e7b56 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
12922024-12-21T06:16:00.956ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12932024-12-21T06:16:00.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12942024-12-21T06:16:00.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12952024-12-21T06:16:00.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12962024-12-21T06:16:00.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12972024-12-21T06:16:00.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12982024-12-21T06:16:00.968ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 617.140406ms iteration = 5 status = {}
12992024-12-21T06:16:01.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4401b296-2d7e-4705-b948-a583ec1e2b8e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13002024-12-21T06:16:01.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4401b296-2d7e-4705-b948-a583ec1e2b8e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13012024-12-21T06:16:01.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2468 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4401b296-2d7e-4705-b948-a583ec1e2b8e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13022024-12-21T06:16:03.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d228026b-0d33-4a09-ad59-2c3269f7a9f2 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13032024-12-21T06:16:03.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d228026b-0d33-4a09-ad59-2c3269f7a9f2 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13042024-12-21T06:16:03.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d228026b-0d33-4a09-ad59-2c3269f7a9f2 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13052024-12-21T06:16:03.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1246 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 59f1dcd7-779e-4b0d-96a3-1e7df724c06d response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
13062024-12-21T06:16:04.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6d2ee885-2018-4770-b1c7-9e793de0c6bd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13072024-12-21T06:16:04.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6d2ee885-2018-4770-b1c7-9e793de0c6bd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13082024-12-21T06:16:04.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6d2ee885-2018-4770-b1c7-9e793de0c6bd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13092024-12-21T06:16:05.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5697a401-b137-4381-b2d9-4a5bcb81bf54 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13102024-12-21T06:16:05.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5697a401-b137-4381-b2d9-4a5bcb81bf54 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13112024-12-21T06:16:05.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5697a401-b137-4381-b2d9-4a5bcb81bf54 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13122024-12-21T06:16:06.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7281cc07-3e62-4925-a137-71258cde5f02 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13132024-12-21T06:16:06.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7281cc07-3e62-4925-a137-71258cde5f02 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13142024-12-21T06:16:06.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7281cc07-3e62-4925-a137-71258cde5f02 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13152024-12-21T06:16:07.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = efe002dd-8026-4538-b914-c58ba39a684f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13162024-12-21T06:16:07.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = efe002dd-8026-4538-b914-c58ba39a684f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13172024-12-21T06:16:07.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = efe002dd-8026-4538-b914-c58ba39a684f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13182024-12-21T06:16:08.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95dbd3c9-2f20-4c91-b0ac-4191a02554dd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13192024-12-21T06:16:08.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95dbd3c9-2f20-4c91-b0ac-4191a02554dd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13202024-12-21T06:16:08.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95dbd3c9-2f20-4c91-b0ac-4191a02554dd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13212024-12-21T06:16:09.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26cf4d7d-9c61-4d67-ba99-29e32aea6d68 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13222024-12-21T06:16:09.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26cf4d7d-9c61-4d67-ba99-29e32aea6d68 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13232024-12-21T06:16:09.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26cf4d7d-9c61-4d67-ba99-29e32aea6d68 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13242024-12-21T06:16:10.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7a2ff0e3-98f0-436c-9e3c-08c3155a105e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13252024-12-21T06:16:10.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7a2ff0e3-98f0-436c-9e3c-08c3155a105e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13262024-12-21T06:16:10.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7a2ff0e3-98f0-436c-9e3c-08c3155a105e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13272024-12-21T06:16:10.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
13282024-12-21T06:16:10.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13292024-12-21T06:16:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13302024-12-21T06:16:10.352ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
13312024-12-21T06:16:10.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13322024-12-21T06:16:10.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13332024-12-21T06:16:10.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13342024-12-21T06:16:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13352024-12-21T06:16:10.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13362024-12-21T06:16:10.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13372024-12-21T06:16:10.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13382024-12-21T06:16:10.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13392024-12-21T06:16:10.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13402024-12-21T06:16:10.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
13412024-12-21T06:16:10.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13422024-12-21T06:16:10.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13432024-12-21T06:16:10.370ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
13442024-12-21T06:16:10.370ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.660343ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
13452024-12-21T06:16:10.381ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13462024-12-21T06:16:10.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13472024-12-21T06:16:10.382ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.916957ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13482024-12-21T06:16:11.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d3d17ea8-5dd1-4071-a2b5-3cfed74c62e5 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13492024-12-21T06:16:11.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d3d17ea8-5dd1-4071-a2b5-3cfed74c62e5 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13502024-12-21T06:16:11.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d3d17ea8-5dd1-4071-a2b5-3cfed74c62e5 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13512024-12-21T06:16:12.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 897acee3-a75e-4c5f-9961-8c680e743a29 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13522024-12-21T06:16:12.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 897acee3-a75e-4c5f-9961-8c680e743a29 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13532024-12-21T06:16:12.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 897acee3-a75e-4c5f-9961-8c680e743a29 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13542024-12-21T06:16:13.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 628ff2aa-3024-4fae-a6aa-db134bc55f79 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13552024-12-21T06:16:13.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 628ff2aa-3024-4fae-a6aa-db134bc55f79 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13562024-12-21T06:16:13.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 628ff2aa-3024-4fae-a6aa-db134bc55f79 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13572024-12-21T06:16:13.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1249 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = af236b2e-2e61-488d-9dd8-3407954344bf response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
13582024-12-21T06:16:14.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = da62f706-524a-4a09-8356-3eccafc4c9e0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13592024-12-21T06:16:14.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = da62f706-524a-4a09-8356-3eccafc4c9e0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13602024-12-21T06:16:14.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = da62f706-524a-4a09-8356-3eccafc4c9e0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13612024-12-21T06:16:15.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cccb129c-b3fb-4a82-b874-42102070a908 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13622024-12-21T06:16:15.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cccb129c-b3fb-4a82-b874-42102070a908 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13632024-12-21T06:16:15.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cccb129c-b3fb-4a82-b874-42102070a908 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13642024-12-21T06:16:16.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c8f120ff-c22e-4cd7-8cfe-10923dbe0da6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13652024-12-21T06:16:16.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c8f120ff-c22e-4cd7-8cfe-10923dbe0da6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13662024-12-21T06:16:16.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c8f120ff-c22e-4cd7-8cfe-10923dbe0da6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13672024-12-21T06:16:17.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 40d31985-ffcc-4a22-903a-2b0b6db7bd01 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13682024-12-21T06:16:17.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 40d31985-ffcc-4a22-903a-2b0b6db7bd01 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13692024-12-21T06:16:17.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 40d31985-ffcc-4a22-903a-2b0b6db7bd01 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13702024-12-21T06:16:18.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 351abf12-7f50-411c-ad76-1bd4733e887c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13712024-12-21T06:16:18.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 351abf12-7f50-411c-ad76-1bd4733e887c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13722024-12-21T06:16:18.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 351abf12-7f50-411c-ad76-1bd4733e887c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13732024-12-21T06:16:19.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 53d02b55-e14f-49fd-9164-df6a125df440 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13742024-12-21T06:16:19.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 53d02b55-e14f-49fd-9164-df6a125df440 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13752024-12-21T06:16:19.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 53d02b55-e14f-49fd-9164-df6a125df440 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13762024-12-21T06:16:20.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
13772024-12-21T06:16:20.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13782024-12-21T06:16:20.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13792024-12-21T06:16:20.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
13802024-12-21T06:16:20.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13812024-12-21T06:16:20.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13822024-12-21T06:16:20.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13832024-12-21T06:16:20.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13842024-12-21T06:16:20.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13852024-12-21T06:16:20.355ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.040772ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13862024-12-21T06:16:20.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13872024-12-21T06:16:20.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13882024-12-21T06:16:20.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13892024-12-21T06:16:20.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13902024-12-21T06:16:20.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13912024-12-21T06:16:20.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13922024-12-21T06:16:20.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
13932024-12-21T06:16:20.362ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13942024-12-21T06:16:20.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13952024-12-21T06:16:20.370ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
13962024-12-21T06:16:20.370ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.084587ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
13972024-12-21T06:16:20.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dd450c4b-eeae-4ab2-a234-38b4d1f1f550 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13982024-12-21T06:16:20.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dd450c4b-eeae-4ab2-a234-38b4d1f1f550 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
13992024-12-21T06:16:20.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1821 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dd450c4b-eeae-4ab2-a234-38b4d1f1f550 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14002024-12-21T06:16:21.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6e7ba8ef-b9ed-4bf4-aae9-218c23b14de0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14012024-12-21T06:16:21.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6e7ba8ef-b9ed-4bf4-aae9-218c23b14de0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14022024-12-21T06:16:21.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6e7ba8ef-b9ed-4bf4-aae9-218c23b14de0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14032024-12-21T06:16:22.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ef57dc19-c1e6-450b-8831-bd52dda6ae37 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14042024-12-21T06:16:22.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ef57dc19-c1e6-450b-8831-bd52dda6ae37 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14052024-12-21T06:16:22.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ef57dc19-c1e6-450b-8831-bd52dda6ae37 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14062024-12-21T06:16:23.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3995371e-b05c-48f1-b42a-b1a85e564469 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14072024-12-21T06:16:23.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3995371e-b05c-48f1-b42a-b1a85e564469 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14082024-12-21T06:16:23.446ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3995371e-b05c-48f1-b42a-b1a85e564469 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14092024-12-21T06:16:23.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1389 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 25167dff-0f22-4aae-9488-63d6c0131f90 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
14102024-12-21T06:16:24.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7f0f5634-8e49-4e92-a8c5-37a07e07200c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14112024-12-21T06:16:24.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7f0f5634-8e49-4e92-a8c5-37a07e07200c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14122024-12-21T06:16:24.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7f0f5634-8e49-4e92-a8c5-37a07e07200c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14132024-12-21T06:16:25.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8840cff2-e6b1-4ff1-b0e7-6cd978d8112c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14142024-12-21T06:16:25.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8840cff2-e6b1-4ff1-b0e7-6cd978d8112c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14152024-12-21T06:16:25.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8840cff2-e6b1-4ff1-b0e7-6cd978d8112c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14162024-12-21T06:16:26.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 02cc3986-86d6-47c2-8ecc-7c6bd07e20ec roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14172024-12-21T06:16:26.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 02cc3986-86d6-47c2-8ecc-7c6bd07e20ec resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14182024-12-21T06:16:26.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 02cc3986-86d6-47c2-8ecc-7c6bd07e20ec response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14192024-12-21T06:16:27.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8fe902ce-b7ee-4321-888b-92e987e12c29 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14202024-12-21T06:16:27.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8fe902ce-b7ee-4321-888b-92e987e12c29 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14212024-12-21T06:16:27.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2849 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8fe902ce-b7ee-4321-888b-92e987e12c29 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14222024-12-21T06:16:28.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 052217dc-848b-421b-92a3-29451a371054 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14232024-12-21T06:16:28.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 052217dc-848b-421b-92a3-29451a371054 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14242024-12-21T06:16:28.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 052217dc-848b-421b-92a3-29451a371054 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14252024-12-21T06:16:29.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ae894f73-2caa-4494-bdeb-6b31ab419bfe roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14262024-12-21T06:16:29.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ae894f73-2caa-4494-bdeb-6b31ab419bfe resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14272024-12-21T06:16:29.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ae894f73-2caa-4494-bdeb-6b31ab419bfe response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
14282024-12-21T06:16:30.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
14292024-12-21T06:16:30.350ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
14302024-12-21T06:16:30.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14312024-12-21T06:16:30.350ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
14322024-12-21T06:16:30.350ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
14332024-12-21T06:16:30.350ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14342024-12-21T06:16:30.350ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14352024-12-21T06:16:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14362024-12-21T06:16:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14372024-12-21T06:16:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14382024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
14392024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
14402024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14412024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
14422024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14432024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
14442024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14452024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14462024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
14472024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
14482024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14492024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
14502024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14512024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
14522024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14532024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
14542024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14552024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14562024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14572024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14582024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14592024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14602024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14612024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14622024-12-21T06:16:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14632024-12-21T06:16:30.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14642024-12-21T06:16:30.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1121, tv_nsec: 437962924 } })
14652024-12-21T06:16:30.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1121, tv_nsec: 438243911 } })
14662024-12-21T06:16:30.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
14672024-12-21T06:16:30.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
14682024-12-21T06:16:30.354ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14692024-12-21T06:16:30.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14702024-12-21T06:16:30.355ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.350069ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14712024-12-21T06:16:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
14722024-12-21T06:16:30.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
14732024-12-21T06:16:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14742024-12-21T06:16:30.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
14752024-12-21T06:16:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14762024-12-21T06:16:30.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14772024-12-21T06:16:30.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14782024-12-21T06:16:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
14792024-12-21T06:16:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
14802024-12-21T06:16:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14812024-12-21T06:16:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14822024-12-21T06:16:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
14832024-12-21T06:16:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14842024-12-21T06:16:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14852024-12-21T06:16:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14862024-12-21T06:16:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14872024-12-21T06:16:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14882024-12-21T06:16:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14892024-12-21T06:16:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14902024-12-21T06:16:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14912024-12-21T06:16:30.357ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14922024-12-21T06:16:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14932024-12-21T06:16:30.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14942024-12-21T06:16:30.358ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14952024-12-21T06:16:30.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14962024-12-21T06:16:30.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14972024-12-21T06:16:30.360ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14982024-12-21T06:16:30.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14992024-12-21T06:16:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15002024-12-21T06:16:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15012024-12-21T06:16:30.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15022024-12-21T06:16:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15032024-12-21T06:16:30.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15042024-12-21T06:16:30.362ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15052024-12-21T06:16:30.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15062024-12-21T06:16:30.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15072024-12-21T06:16:30.364ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15082024-12-21T06:16:30.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15092024-12-21T06:16:30.365ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15102024-12-21T06:16:30.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15112024-12-21T06:16:30.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15122024-12-21T06:16:30.367ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15132024-12-21T06:16:30.368ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15142024-12-21T06:16:30.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15152024-12-21T06:16:30.369ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15162024-12-21T06:16:30.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15172024-12-21T06:16:30.369ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1121, tv_nsec: 454164233 } })
15182024-12-21T06:16:30.370ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
15192024-12-21T06:16:30.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
15202024-12-21T06:16:30.370ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15212024-12-21T06:16:30.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15222024-12-21T06:16:30.372ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15232024-12-21T06:16:30.373ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15242024-12-21T06:16:30.373ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15252024-12-21T06:16:30.373ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 22.106783ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15262024-12-21T06:16:30.374ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15272024-12-21T06:16:30.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15282024-12-21T06:16:30.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15292024-12-21T06:16:30.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15302024-12-21T06:16:30.377ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15312024-12-21T06:16:30.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15322024-12-21T06:16:30.387ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 35.840904ms iteration = 9 status = {"physical_disks_added":0}
15332024-12-21T06:16:30.387ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15342024-12-21T06:16:30.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15352024-12-21T06:16:30.389ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
15362024-12-21T06:16:30.389ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 39.010102ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
15372024-12-21T06:16:30.398ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15382024-12-21T06:16:30.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15392024-12-21T06:16:30.401ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15402024-12-21T06:16:30.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15412024-12-21T06:16:30.403ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15422024-12-21T06:16:30.404ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15432024-12-21T06:16:30.404ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15442024-12-21T06:16:30.404ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15452024-12-21T06:16:30.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15462024-12-21T06:16:30.404ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15472024-12-21T06:16:30.405ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.276799ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
15482024-12-21T06:16:30.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15492024-12-21T06:16:30.406ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15502024-12-21T06:16:30.406ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15512024-12-21T06:16:30.406ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15522024-12-21T06:16:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
15532024-12-21T06:16:30.407ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15542024-12-21T06:16:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15552024-12-21T06:16:30.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 50.358447ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
15562024-12-21T06:16:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15572024-12-21T06:16:30.407ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15582024-12-21T06:16:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15592024-12-21T06:16:30.409ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15602024-12-21T06:16:30.409ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15612024-12-21T06:16:30.409ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 58.454921ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15622024-12-21T06:16:30.410ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 58.935265ms iteration = 6 status = 0
15632024-12-21T06:16:30.410ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
15642024-12-21T06:16:30.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15652024-12-21T06:16:30.419ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15662024-12-21T06:16:30.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15672024-12-21T06:16:30.427ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.745158ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15682024-12-21T06:16:30.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.681889ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15692024-12-21T06:16:30.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 83.696561ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
15702024-12-21T06:16:30.444ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15712024-12-21T06:16:30.444ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15722024-12-21T06:16:30.445ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f35758eb-f410-43c4-ba2b-8163984488ab", "content-length": "26", "date": "Sat, 21 Dec 2024 06:16:30 GMT"} })
15732024-12-21T06:16:30.445ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15742024-12-21T06:16:30.446ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15752024-12-21T06:16:30.446ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
15762024-12-21T06:16:30.446ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15772024-12-21T06:16:30.446ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0f55c08-2f24-43e9-9831-0db8879bef95", "content-length": "26", "date": "Sat, 21 Dec 2024 06:16:30 GMT"} })
15782024-12-21T06:16:30.446ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15792024-12-21T06:16:30.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 89.733258ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
15802024-12-21T06:16:30.447ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15812024-12-21T06:16:30.469ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
15822024-12-21T06:16:30.469ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15832024-12-21T06:16:30.469ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d652156-d603-440a-87a8-76837c0295a9", "content-length": "26", "date": "Sat, 21 Dec 2024 06:16:30 GMT"} })
15842024-12-21T06:16:30.469ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15852024-12-21T06:16:30.470ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
15862024-12-21T06:16:30.517ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15872024-12-21T06:16:30.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15882024-12-21T06:16:30.518ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15892024-12-21T06:16:30.520ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15902024-12-21T06:16:30.520ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15912024-12-21T06:16:30.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15922024-12-21T06:16:30.535ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15932024-12-21T06:16:30.535ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15942024-12-21T06:16:30.535ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fb46866-556f-4da3-a893-493434192493", "content-length": "372", "date": "Sat, 21 Dec 2024 06:16:30 GMT"} })
15952024-12-21T06:16:30.535ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15962024-12-21T06:16:30.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15972024-12-21T06:16:30.543ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 193.308162ms iteration = 6 status = {}
15982024-12-21T06:16:30.544ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15992024-12-21T06:16:30.544ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "68ec5fc8-d251-41a1-955c-b85490f52468", "content-length": "1", "date": "Sat, 21 Dec 2024 06:16:30 GMT"} })
16002024-12-21T06:16:30.545ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16012024-12-21T06:16:30.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16022024-12-21T06:16:30.548ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 198.167696ms iteration = 6 status = null
16032024-12-21T06:16:30.550ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
16042024-12-21T06:16:30.550ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
16052024-12-21T06:16:30.550ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "88c69909-195d-4dbd-8b90-8a84d8879959", "date": "Sat, 21 Dec 2024 06:16:30 GMT"} })
16062024-12-21T06:16:30.550ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16072024-12-21T06:16:30.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16082024-12-21T06:16:30.552ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16092024-12-21T06:16:30.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16102024-12-21T06:16:30.556ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16112024-12-21T06:16:30.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16122024-12-21T06:16:30.559ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16132024-12-21T06:16:30.559ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16142024-12-21T06:16:30.560ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "300d8364-db60-4318-8639-148255d0f8a5", "date": "Sat, 21 Dec 2024 06:16:30 GMT"} })
16152024-12-21T06:16:30.561ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 204.309767ms iteration = 7 status = {}
16162024-12-21T06:16:30.567ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16172024-12-21T06:16:30.569ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16182024-12-21T06:16:30.569ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16192024-12-21T06:16:30.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16202024-12-21T06:16:30.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ea73c47-b207-4937-80f2-4e33c6c92a84 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16212024-12-21T06:16:30.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ea73c47-b207-4937-80f2-4e33c6c92a84 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16222024-12-21T06:16:30.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2520 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ea73c47-b207-4937-80f2-4e33c6c92a84 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16232024-12-21T06:16:30.638ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16242024-12-21T06:16:30.638ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0b3cb14-a47e-4454-9d1d-bcfcc58c7f58", "content-length": "691", "date": "Sat, 21 Dec 2024 06:16:30 GMT"} })
16252024-12-21T06:16:30.639ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
16262024-12-21T06:16:30.639ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
16272024-12-21T06:16:30.639ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
16282024-12-21T06:16:30.641ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 290.030304ms iteration = 6 status = {}
16292024-12-21T06:16:30.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16302024-12-21T06:16:30.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16312024-12-21T06:16:30.651ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
16322024-12-21T06:16:30.651ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16332024-12-21T06:16:30.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16342024-12-21T06:16:30.661ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16352024-12-21T06:16:30.661ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "abfccc55-21ad-463b-858b-46664974d56f", "content-length": "134", "date": "Sat, 21 Dec 2024 06:16:30 GMT"} })
16362024-12-21T06:16:30.661ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16372024-12-21T06:16:30.661ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
16382024-12-21T06:16:30.661ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16392024-12-21T06:16:30.661ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16402024-12-21T06:16:30.661ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16412024-12-21T06:16:30.661ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16422024-12-21T06:16:30.661ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16432024-12-21T06:16:30.661ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16442024-12-21T06:16:30.661ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16452024-12-21T06:16:30.661ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16462024-12-21T06:16:30.662ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
16472024-12-21T06:16:30.662ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16482024-12-21T06:16:30.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16492024-12-21T06:16:30.664ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16502024-12-21T06:16:30.664ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f2a1f17-0981-4afd-aac6-f8f58bde0d7e", "content-length": "2", "date": "Sat, 21 Dec 2024 06:16:30 GMT"} })
16512024-12-21T06:16:30.664ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16522024-12-21T06:16:30.664ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "29f1b88e-f162-4681-aec9-9ea5464b588c", "content-length": "52", "date": "Sat, 21 Dec 2024 06:16:30 GMT"} })
16532024-12-21T06:16:30.664ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
16542024-12-21T06:16:30.664ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16552024-12-21T06:16:30.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a1653fd2-c1ff-401c-a5b9-a4c751aba85a", "date": "Sat, 21 Dec 2024 06:16:30 GMT"} })
16562024-12-21T06:16:30.755ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
16572024-12-21T06:16:30.755ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16582024-12-21T06:16:30.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9160bdcc-c2ac-435d-940e-338c7b67267f", "content-length": "682", "date": "Sat, 21 Dec 2024 06:16:30 GMT"} })
16592024-12-21T06:16:30.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16602024-12-21T06:16:30.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16612024-12-21T06:16:30.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16622024-12-21T06:16:30.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16632024-12-21T06:16:30.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16642024-12-21T06:16:30.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16652024-12-21T06:16:30.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16662024-12-21T06:16:30.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16672024-12-21T06:16:30.772ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 421.181392ms iteration = 6 status = {}
16682024-12-21T06:16:30.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = a3b25dd3-6573-44c8-978f-29a839b44394 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
16692024-12-21T06:16:30.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = a3b25dd3-6573-44c8-978f-29a839b44394 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
16702024-12-21T06:16:30.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = a3b25dd3-6573-44c8-978f-29a839b44394 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
16712024-12-21T06:16:31.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ed0a9a67-7923-43b1-b64a-ba26a51c11bd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16722024-12-21T06:16:31.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ed0a9a67-7923-43b1-b64a-ba26a51c11bd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16732024-12-21T06:16:31.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ed0a9a67-7923-43b1-b64a-ba26a51c11bd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16742024-12-21T06:16:32.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e0a17245-98fb-4118-9f2b-c468ffbb4f5c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16752024-12-21T06:16:32.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e0a17245-98fb-4118-9f2b-c468ffbb4f5c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16762024-12-21T06:16:32.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e0a17245-98fb-4118-9f2b-c468ffbb4f5c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16772024-12-21T06:16:32.978ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:52270
16782024-12-21T06:16:32.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52270 req_id = 9d818920-00cc-40e3-8cff-5881ff7bf583 roles = RoleSet { roles: {} } uri = /metrics/producers
16792024-12-21T06:16:32.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52270 req_id = 9d818920-00cc-40e3-8cff-5881ff7bf583 resource = Database result = Ok(()) uri = /metrics/producers
16802024-12-21T06:16:33.021ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 98955a77-d432-4135-98da-54d3ff354ace
16812024-12-21T06:16:33.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43053 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52270 req_id = 9d818920-00cc-40e3-8cff-5881ff7bf583 response_code = 201 uri = /metrics/producers
16822024-12-21T06:16:33.610ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:55126
16832024-12-21T06:16:33.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55126 req_id = 89d8a121-cfa5-45ea-bff5-22f58f01539d roles = RoleSet { roles: {} } uri = /metrics/producers
16842024-12-21T06:16:33.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55126 req_id = 89d8a121-cfa5-45ea-bff5-22f58f01539d resource = Database result = Ok(()) uri = /metrics/producers
16852024-12-21T06:16:33.655ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = d1b17d65-9e31-4f7b-88f5-d7566540099b
16862024-12-21T06:16:33.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45392 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55126 req_id = 89d8a121-cfa5-45ea-bff5-22f58f01539d response_code = 201 uri = /metrics/producers
16872024-12-21T06:16:33.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e4ef9c4a-726d-4b04-868b-9d9eea0158ac roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16882024-12-21T06:16:33.747ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e4ef9c4a-726d-4b04-868b-9d9eea0158ac resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16892024-12-21T06:16:33.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2658 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e4ef9c4a-726d-4b04-868b-9d9eea0158ac response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16902024-12-21T06:16:33.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1267 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 7e13e213-770f-4a47-bf73-fe26eaf90373 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
16912024-12-21T06:16:34.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a99aba26-bde6-4f21-bddf-19c2dc2fbfeb roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16922024-12-21T06:16:34.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a99aba26-bde6-4f21-bddf-19c2dc2fbfeb resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16932024-12-21T06:16:34.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a99aba26-bde6-4f21-bddf-19c2dc2fbfeb response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
16942024-12-21T06:16:35.325ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:63844
16952024-12-21T06:16:35.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63844 req_id = eebb14e8-6e20-42a7-80b5-59e952614353 roles = RoleSet { roles: {} } uri = /metrics/producers
16962024-12-21T06:16:35.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63844 req_id = eebb14e8-6e20-42a7-80b5-59e952614353 resource = Database result = Ok(()) uri = /metrics/producers
16972024-12-21T06:16:35.398ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 0816076d-2e0e-472b-89a8-a9ecbfd48b43
16982024-12-21T06:16:35.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73180 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63844 req_id = eebb14e8-6e20-42a7-80b5-59e952614353 response_code = 201 uri = /metrics/producers
16992024-12-21T06:16:35.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6f4448b5-e92e-4288-a426-34d1f08b75b5 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17002024-12-21T06:16:35.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6f4448b5-e92e-4288-a426-34d1f08b75b5 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17012024-12-21T06:16:35.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6f4448b5-e92e-4288-a426-34d1f08b75b5 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17022024-12-21T06:16:36.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9d56ece6-3252-4171-a580-d3436f7597a1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17032024-12-21T06:16:36.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9d56ece6-3252-4171-a580-d3436f7597a1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17042024-12-21T06:16:36.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9d56ece6-3252-4171-a580-d3436f7597a1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17052024-12-21T06:16:37.402ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:63814
17062024-12-21T06:16:37.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63814 req_id = 206840d0-19c3-4131-8ade-1e174c3e41a9 roles = RoleSet { roles: {} } uri = /metrics/producers
17072024-12-21T06:16:37.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63814 req_id = 206840d0-19c3-4131-8ade-1e174c3e41a9 resource = Database result = Ok(()) uri = /metrics/producers
17082024-12-21T06:16:37.523ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
17092024-12-21T06:16:37.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120876 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63814 req_id = 206840d0-19c3-4131-8ade-1e174c3e41a9 response_code = 201 uri = /metrics/producers
17102024-12-21T06:16:37.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c42e221a-94f0-492a-a8ac-78017f05c7a6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17112024-12-21T06:16:37.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c42e221a-94f0-492a-a8ac-78017f05c7a6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17122024-12-21T06:16:37.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c42e221a-94f0-492a-a8ac-78017f05c7a6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17132024-12-21T06:16:38.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e8c5d1d8-221f-4d19-9102-00edb7d05861 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17142024-12-21T06:16:38.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e8c5d1d8-221f-4d19-9102-00edb7d05861 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17152024-12-21T06:16:38.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e8c5d1d8-221f-4d19-9102-00edb7d05861 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17162024-12-21T06:16:39.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8796ddc6-9925-42f7-a08b-ad83fe1ba36e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17172024-12-21T06:16:39.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8796ddc6-9925-42f7-a08b-ad83fe1ba36e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17182024-12-21T06:16:39.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8796ddc6-9925-42f7-a08b-ad83fe1ba36e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17192024-12-21T06:16:40.351ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
17202024-12-21T06:16:40.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17212024-12-21T06:16:40.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17222024-12-21T06:16:40.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
17232024-12-21T06:16:40.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17242024-12-21T06:16:40.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17252024-12-21T06:16:40.380ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17262024-12-21T06:16:40.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17272024-12-21T06:16:40.381ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
17282024-12-21T06:16:40.381ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
17292024-12-21T06:16:40.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17302024-12-21T06:16:40.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17312024-12-21T06:16:40.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17322024-12-21T06:16:40.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17332024-12-21T06:16:40.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17342024-12-21T06:16:40.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17352024-12-21T06:16:40.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17362024-12-21T06:16:40.390ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
17372024-12-21T06:16:40.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17382024-12-21T06:16:40.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17392024-12-21T06:16:40.405ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
17402024-12-21T06:16:40.405ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.361017ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
17412024-12-21T06:16:40.412ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
17422024-12-21T06:16:40.412ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:47228
17432024-12-21T06:16:40.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47228 req_id = bb6d10d8-b28f-4eaa-885b-2a8dd64303aa roles = RoleSet { roles: {} } uri = /metrics/producers
17442024-12-21T06:16:40.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47228 req_id = bb6d10d8-b28f-4eaa-885b-2a8dd64303aa resource = Database result = Ok(()) uri = /metrics/producers
17452024-12-21T06:16:40.414ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.949436ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17462024-12-21T06:16:40.457ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
17472024-12-21T06:16:40.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44804 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:47228 req_id = bb6d10d8-b28f-4eaa-885b-2a8dd64303aa response_code = 201 uri = /metrics/producers
17482024-12-21T06:16:40.457ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "bb6d10d8-b28f-4eaa-885b-2a8dd64303aa", "content-length": "41", "date": "Sat, 21 Dec 2024 06:16:39 GMT"} })
17492024-12-21T06:16:40.459ZDEBGnexus (producer-registration-task): registered with nexus successfully
17502024-12-21T06:16:40.459ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
17512024-12-21T06:16:40.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cbfcf158-868c-498c-a9ba-92fa2763bdf4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17522024-12-21T06:16:40.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cbfcf158-868c-498c-a9ba-92fa2763bdf4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17532024-12-21T06:16:40.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cbfcf158-868c-498c-a9ba-92fa2763bdf4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17542024-12-21T06:16:41.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0d56d2de-8d86-4f53-8bab-717a273b65f8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17552024-12-21T06:16:41.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0d56d2de-8d86-4f53-8bab-717a273b65f8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17562024-12-21T06:16:41.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0d56d2de-8d86-4f53-8bab-717a273b65f8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17572024-12-21T06:16:42.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4213deef-a9d4-4206-8d88-c19c11a0df14 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17582024-12-21T06:16:42.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4213deef-a9d4-4206-8d88-c19c11a0df14 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17592024-12-21T06:16:42.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4213deef-a9d4-4206-8d88-c19c11a0df14 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17602024-12-21T06:16:43.097ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:44305
17612024-12-21T06:16:43.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44305 req_id = 720d24a1-a74c-401d-88ee-998cb5c49458 roles = RoleSet { roles: {} } uri = /metrics/producers
17622024-12-21T06:16:43.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44305 req_id = 720d24a1-a74c-401d-88ee-998cb5c49458 resource = Database result = Ok(()) uri = /metrics/producers
17632024-12-21T06:16:43.114ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 49f39df6-9f0d-49d5-a626-07ee31ec1ff4
17642024-12-21T06:16:43.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16778 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44305 req_id = 720d24a1-a74c-401d-88ee-998cb5c49458 response_code = 201 uri = /metrics/producers
17652024-12-21T06:16:43.536ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:54639
17662024-12-21T06:16:43.537ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54639 req_id = 02154c2e-7801-44b1-b229-35559a8a0ba1 roles = RoleSet { roles: {} } uri = /metrics/producers
17672024-12-21T06:16:43.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54639 req_id = 02154c2e-7801-44b1-b229-35559a8a0ba1 resource = Database result = Ok(()) uri = /metrics/producers
17682024-12-21T06:16:43.564ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 47090b0b-c8ad-4dca-92e5-38fed29ad6d5
17692024-12-21T06:16:43.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27293 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54639 req_id = 02154c2e-7801-44b1-b229-35559a8a0ba1 response_code = 201 uri = /metrics/producers
17702024-12-21T06:16:43.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 818c3e53-af96-44d5-b544-be891a5f05d7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17712024-12-21T06:16:43.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 818c3e53-af96-44d5-b544-be891a5f05d7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17722024-12-21T06:16:43.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 818c3e53-af96-44d5-b544-be891a5f05d7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17732024-12-21T06:16:43.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1251 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 4a96d622-1ec7-4544-b4f2-d7112756854c response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
17742024-12-21T06:16:44.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf1805e5-a9cc-48b0-b4b0-068cc0e7ef62 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17752024-12-21T06:16:44.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf1805e5-a9cc-48b0-b4b0-068cc0e7ef62 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17762024-12-21T06:16:44.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf1805e5-a9cc-48b0-b4b0-068cc0e7ef62 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17772024-12-21T06:16:46.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = af9a3902-ee7d-4015-ae80-ad1f4560c5ef roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17782024-12-21T06:16:46.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = af9a3902-ee7d-4015-ae80-ad1f4560c5ef resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17792024-12-21T06:16:46.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2060 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = af9a3902-ee7d-4015-ae80-ad1f4560c5ef response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17802024-12-21T06:16:47.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 44cfb7d8-ae40-4fb4-bcca-06da484f02ef roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17812024-12-21T06:16:47.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 44cfb7d8-ae40-4fb4-bcca-06da484f02ef resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17822024-12-21T06:16:47.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 44cfb7d8-ae40-4fb4-bcca-06da484f02ef response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17832024-12-21T06:16:48.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 302ccc22-bbb7-46ce-9f08-eb381622ba6f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17842024-12-21T06:16:48.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 302ccc22-bbb7-46ce-9f08-eb381622ba6f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17852024-12-21T06:16:48.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 302ccc22-bbb7-46ce-9f08-eb381622ba6f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17862024-12-21T06:16:49.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 61468d46-4551-491d-b504-8cdcc4bf7a9f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17872024-12-21T06:16:49.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 61468d46-4551-491d-b504-8cdcc4bf7a9f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17882024-12-21T06:16:49.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 61468d46-4551-491d-b504-8cdcc4bf7a9f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17892024-12-21T06:16:50.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 50f2c24f-0a09-4136-9124-eba6b63f89d0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17902024-12-21T06:16:50.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 50f2c24f-0a09-4136-9124-eba6b63f89d0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17912024-12-21T06:16:50.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 50f2c24f-0a09-4136-9124-eba6b63f89d0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
17922024-12-21T06:16:50.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
17932024-12-21T06:16:50.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17942024-12-21T06:16:50.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17952024-12-21T06:16:50.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
17962024-12-21T06:16:50.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17972024-12-21T06:16:50.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17982024-12-21T06:16:50.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17992024-12-21T06:16:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18002024-12-21T06:16:50.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18012024-12-21T06:16:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18022024-12-21T06:16:50.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18032024-12-21T06:16:50.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18042024-12-21T06:16:50.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18052024-12-21T06:16:50.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
18062024-12-21T06:16:50.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18072024-12-21T06:16:50.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18082024-12-21T06:16:50.372ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
18092024-12-21T06:16:50.372ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.64161ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
18102024-12-21T06:16:50.380ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18112024-12-21T06:16:50.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18122024-12-21T06:16:50.382ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.137393ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18132024-12-21T06:16:51.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6dc7b6f-3b7a-4632-89b3-3dbd7d8e18eb roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18142024-12-21T06:16:51.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6dc7b6f-3b7a-4632-89b3-3dbd7d8e18eb resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18152024-12-21T06:16:51.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2118 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6dc7b6f-3b7a-4632-89b3-3dbd7d8e18eb response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18162024-12-21T06:16:52.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 27613a93-c955-4a56-b501-1aa121b2985d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18172024-12-21T06:16:52.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 27613a93-c955-4a56-b501-1aa121b2985d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18182024-12-21T06:16:52.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 27613a93-c955-4a56-b501-1aa121b2985d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18192024-12-21T06:16:53.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4c2d2167-ad04-403e-a5a8-c84e3eb11cfd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18202024-12-21T06:16:53.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4c2d2167-ad04-403e-a5a8-c84e3eb11cfd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18212024-12-21T06:16:53.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4c2d2167-ad04-403e-a5a8-c84e3eb11cfd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18222024-12-21T06:16:53.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1662 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 66c4af69-9447-41d2-9cc5-cf77d3de0b09 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
18232024-12-21T06:16:54.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4cbaaa0d-4786-495b-9a0a-e1039cdd5e10 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18242024-12-21T06:16:54.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4cbaaa0d-4786-495b-9a0a-e1039cdd5e10 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18252024-12-21T06:16:54.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4cbaaa0d-4786-495b-9a0a-e1039cdd5e10 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18262024-12-21T06:16:55.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 96aa4eed-48eb-45a7-b0fb-1a80719f2296 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18272024-12-21T06:16:55.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 96aa4eed-48eb-45a7-b0fb-1a80719f2296 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18282024-12-21T06:16:55.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 96aa4eed-48eb-45a7-b0fb-1a80719f2296 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18292024-12-21T06:16:56.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 62676ee3-3a52-409e-a693-2df230187bc7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18302024-12-21T06:16:56.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 62676ee3-3a52-409e-a693-2df230187bc7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18312024-12-21T06:16:56.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 62676ee3-3a52-409e-a693-2df230187bc7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18322024-12-21T06:16:57.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = debd86aa-d253-4fa2-a8b1-1f12332c3fa3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18332024-12-21T06:16:57.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = debd86aa-d253-4fa2-a8b1-1f12332c3fa3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18342024-12-21T06:16:57.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = debd86aa-d253-4fa2-a8b1-1f12332c3fa3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18352024-12-21T06:16:58.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 19899b09-b199-4995-b616-3a95f95d096f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18362024-12-21T06:16:58.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 19899b09-b199-4995-b616-3a95f95d096f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18372024-12-21T06:16:58.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 19899b09-b199-4995-b616-3a95f95d096f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18382024-12-21T06:16:59.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8af5c77e-d321-43d5-b52d-a12355d91a46 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18392024-12-21T06:16:59.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8af5c77e-d321-43d5-b52d-a12355d91a46 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18402024-12-21T06:16:59.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8af5c77e-d321-43d5-b52d-a12355d91a46 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18412024-12-21T06:17:00.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 81d18f7d-aad1-428f-bf6a-16c28448a405 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18422024-12-21T06:17:00.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 81d18f7d-aad1-428f-bf6a-16c28448a405 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18432024-12-21T06:17:00.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 81d18f7d-aad1-428f-bf6a-16c28448a405 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
18442024-12-21T06:17:00.350ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
18452024-12-21T06:17:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
18462024-12-21T06:17:00.350ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18472024-12-21T06:17:00.350ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
18482024-12-21T06:17:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
18492024-12-21T06:17:00.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18502024-12-21T06:17:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
18512024-12-21T06:17:00.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
18522024-12-21T06:17:00.350ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 7c419228-2431-4394-af83-ea0457364b70
18532024-12-21T06:17:00.350ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.45\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"7c419228-2431-4394-af83-ea0457364b70"}
18542024-12-21T06:17:00.350ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
18552024-12-21T06:17:00.350ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
18562024-12-21T06:17:00.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
18572024-12-21T06:17:00.350ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18582024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18592024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
18602024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
18612024-12-21T06:17:00.351ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 06:07:00.350955636 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
18622024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
18632024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
18642024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
18652024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18662024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
18672024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18682024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
18692024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
18702024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18712024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
18722024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18732024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
18742024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
18752024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18762024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
18772024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
18782024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18792024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
18802024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
18812024-12-21T06:17:00.351ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
18822024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18832024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18842024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
18852024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18862024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18872024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
18882024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18892024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
18902024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18912024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
18922024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18932024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18942024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18952024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18962024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18972024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18982024-12-21T06:17:00.351ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("068965c6-3480-4953-b57e-dd969abb2a21.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("45c0a855-5592-491c-b7b3-470902319db2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1151, tv_nsec: 436205375 } })
18992024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19002024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19012024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
19022024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
19032024-12-21T06:17:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19042024-12-21T06:17:00.352ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1151, tv_nsec: 436366039 } })
19052024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19062024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19072024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19082024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19092024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19102024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19112024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19122024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19132024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19142024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19152024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19162024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19172024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19182024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19192024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
19202024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.650506ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
19212024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
19222024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.557483ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
19232024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19242024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19252024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19262024-12-21T06:17:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19272024-12-21T06:17:00.354ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19282024-12-21T06:17:00.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1151, tv_nsec: 438754275 } })
19292024-12-21T06:17:00.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19302024-12-21T06:17:00.354ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19312024-12-21T06:17:00.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
19322024-12-21T06:17:00.355ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1151, tv_nsec: 439452125 } })
19332024-12-21T06:17:00.355ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
19342024-12-21T06:17:00.355ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.799293ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19352024-12-21T06:17:00.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19362024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19372024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
19382024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19392024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
19402024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19412024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
19422024-12-21T06:17:00.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19432024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19442024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
19452024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
19462024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
19472024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
19482024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
19492024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19502024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
19512024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19522024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
19532024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19542024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19552024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19562024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19572024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19582024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
19592024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
19602024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19612024-12-21T06:17:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
19622024-12-21T06:17:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19632024-12-21T06:17:00.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19642024-12-21T06:17:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19652024-12-21T06:17:00.358ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19662024-12-21T06:17:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19672024-12-21T06:17:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19682024-12-21T06:17:00.358ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 06:07:00.350955636 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
19692024-12-21T06:17:00.358ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.9404ms iteration = 4 status = {"expiration":"2024-12-21T06:07:00.350955636Z","pruned":[]}
19702024-12-21T06:17:00.360ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19712024-12-21T06:17:00.360ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19722024-12-21T06:17:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19732024-12-21T06:17:00.363ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19742024-12-21T06:17:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19752024-12-21T06:17:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19762024-12-21T06:17:00.363ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19772024-12-21T06:17:00.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19782024-12-21T06:17:00.369ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19792024-12-21T06:17:00.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19802024-12-21T06:17:00.372ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19812024-12-21T06:17:00.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19822024-12-21T06:17:00.372ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19832024-12-21T06:17:00.374ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19842024-12-21T06:17:00.374ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19852024-12-21T06:17:00.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19862024-12-21T06:17:00.374ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19872024-12-21T06:17:00.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19882024-12-21T06:17:00.376ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
19892024-12-21T06:17:00.377ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
19902024-12-21T06:17:00.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
19912024-12-21T06:17:00.377ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19922024-12-21T06:17:00.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19932024-12-21T06:17:00.379ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19942024-12-21T06:17:00.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19952024-12-21T06:17:00.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19962024-12-21T06:17:00.382ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.091984ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
19972024-12-21T06:17:00.382ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19982024-12-21T06:17:00.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19992024-12-21T06:17:00.383ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 26.950808ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
20002024-12-21T06:17:00.385ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20012024-12-21T06:17:00.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20022024-12-21T06:17:00.386ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1151, tv_nsec: 470737973 } })
20032024-12-21T06:17:00.386ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20042024-12-21T06:17:00.386ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
20052024-12-21T06:17:00.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20062024-12-21T06:17:00.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20072024-12-21T06:17:00.408ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20082024-12-21T06:17:00.411ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20092024-12-21T06:17:00.411ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20102024-12-21T06:17:00.411ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20112024-12-21T06:17:00.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20122024-12-21T06:17:00.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20132024-12-21T06:17:00.412ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20142024-12-21T06:17:00.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20152024-12-21T06:17:00.414ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20162024-12-21T06:17:00.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
20172024-12-21T06:17:00.414ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20182024-12-21T06:17:00.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20192024-12-21T06:17:00.414ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20202024-12-21T06:17:00.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
20212024-12-21T06:17:00.417ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
20222024-12-21T06:17:00.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
20232024-12-21T06:17:00.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20242024-12-21T06:17:00.419ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20252024-12-21T06:17:00.419ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20262024-12-21T06:17:00.419ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20272024-12-21T06:17:00.419ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20282024-12-21T06:17:00.419ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20292024-12-21T06:17:00.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20302024-12-21T06:17:00.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20312024-12-21T06:17:00.419ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20322024-12-21T06:17:00.419ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20332024-12-21T06:17:00.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20342024-12-21T06:17:00.420ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20352024-12-21T06:17:00.422ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20362024-12-21T06:17:00.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20372024-12-21T06:17:00.422ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
20382024-12-21T06:17:00.422ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20392024-12-21T06:17:00.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20402024-12-21T06:17:00.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20412024-12-21T06:17:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20422024-12-21T06:17:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20432024-12-21T06:17:00.424ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20442024-12-21T06:17:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20452024-12-21T06:17:00.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
20462024-12-21T06:17:00.425ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20472024-12-21T06:17:00.425ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
20482024-12-21T06:17:00.425ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
20492024-12-21T06:17:00.425ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
20502024-12-21T06:17:00.425ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20512024-12-21T06:17:00.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20522024-12-21T06:17:00.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20532024-12-21T06:17:00.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20542024-12-21T06:17:00.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20552024-12-21T06:17:00.426ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.437463ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
20562024-12-21T06:17:00.427ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.989868ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20572024-12-21T06:17:00.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20582024-12-21T06:17:00.430ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20592024-12-21T06:17:00.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20602024-12-21T06:17:00.431ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
20612024-12-21T06:17:00.431ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
20622024-12-21T06:17:00.432ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 75.754401ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
20632024-12-21T06:17:00.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20642024-12-21T06:17:00.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20652024-12-21T06:17:00.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20662024-12-21T06:17:00.436ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20672024-12-21T06:17:00.437ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20682024-12-21T06:17:00.437ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.969725ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20692024-12-21T06:17:00.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20702024-12-21T06:17:00.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
20712024-12-21T06:17:00.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20722024-12-21T06:17:00.445ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20732024-12-21T06:17:00.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20742024-12-21T06:17:00.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20752024-12-21T06:17:00.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20762024-12-21T06:17:00.450ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20772024-12-21T06:17:00.452ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
20782024-12-21T06:17:00.452ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
20792024-12-21T06:17:00.452ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
20802024-12-21T06:17:00.452ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20812024-12-21T06:17:00.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20822024-12-21T06:17:00.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
20832024-12-21T06:17:00.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20842024-12-21T06:17:00.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20852024-12-21T06:17:00.456ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.64769ms iteration = 7 status = 0
20862024-12-21T06:17:00.463ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20872024-12-21T06:17:00.465ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20882024-12-21T06:17:00.466ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20892024-12-21T06:17:00.466ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20902024-12-21T06:17:00.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20912024-12-21T06:17:00.466ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
20922024-12-21T06:17:00.466ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
20932024-12-21T06:17:00.466ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 115.074492ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
20942024-12-21T06:17:00.467ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20952024-12-21T06:17:00.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20962024-12-21T06:17:00.468ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20972024-12-21T06:17:00.468ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20982024-12-21T06:17:00.468ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 117.474368ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20992024-12-21T06:17:00.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
21002024-12-21T06:17:00.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21012024-12-21T06:17:00.469ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21022024-12-21T06:17:00.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21032024-12-21T06:17:00.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
21042024-12-21T06:17:00.471ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21052024-12-21T06:17:00.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21062024-12-21T06:17:00.479ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 123.107525ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21072024-12-21T06:17:00.481ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
21082024-12-21T06:17:00.481ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
21092024-12-21T06:17:00.481ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21102024-12-21T06:17:00.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21112024-12-21T06:17:00.482ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21122024-12-21T06:17:00.483ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 127.324891ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
21132024-12-21T06:17:00.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
21142024-12-21T06:17:00.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21152024-12-21T06:17:00.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
21162024-12-21T06:17:00.494ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
21172024-12-21T06:17:00.494ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 143.963113ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
21182024-12-21T06:17:00.499ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
21192024-12-21T06:17:00.500ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21202024-12-21T06:17:00.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21212024-12-21T06:17:00.510ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
21222024-12-21T06:17:00.510ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 0 version = 2
21232024-12-21T06:17:00.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21242024-12-21T06:17:00.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21252024-12-21T06:17:00.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
21262024-12-21T06:17:00.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
21272024-12-21T06:17:00.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21282024-12-21T06:17:00.513ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
21292024-12-21T06:17:00.513ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 162.007283ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
21302024-12-21T06:17:00.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21312024-12-21T06:17:00.515ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21322024-12-21T06:17:00.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21332024-12-21T06:17:00.520ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 169.610934ms iteration = 3 status = {"nsuccess":5}
21342024-12-21T06:17:00.524ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21352024-12-21T06:17:00.524ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21362024-12-21T06:17:00.524ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d18a09c-1692-4dda-bab0-e6e4ef56dc7b", "content-length": "26", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} })
21372024-12-21T06:17:00.524ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21382024-12-21T06:17:00.526ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21392024-12-21T06:17:00.540ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 189.583118ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
21402024-12-21T06:17:00.552ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 200.864131ms iteration = 10 status = {"physical_disks_added":0}
21412024-12-21T06:17:00.589ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
21422024-12-21T06:17:00.589ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
21432024-12-21T06:17:00.589ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 06:14:07.931887 UTC dns_group = internal generation = 1
21442024-12-21T06:17:00.589ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 239.05734ms iteration = 5 status = {"generation":1}
21452024-12-21T06:17:00.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21462024-12-21T06:17:00.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21472024-12-21T06:17:00.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21482024-12-21T06:17:00.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21492024-12-21T06:17:00.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21502024-12-21T06:17:00.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21512024-12-21T06:17:00.610ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21522024-12-21T06:17:00.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21532024-12-21T06:17:00.612ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21542024-12-21T06:17:00.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21552024-12-21T06:17:00.632ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 1 version = 2
21562024-12-21T06:17:00.632ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
21572024-12-21T06:17:00.632ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 06:14:08.776888 UTC dns_group = external generation = 2
21582024-12-21T06:17:00.632ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 281.454497ms iteration = 5 status = {"generation":2}
21592024-12-21T06:17:00.682ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
21602024-12-21T06:17:00.682ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b8a8a2fa-412c-42aa-98ba-1502682e18f7", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21612024-12-21T06:17:00.682ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21622024-12-21T06:17:00.683ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5387d444-a89d-4317-944b-67c7a0d687ca", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21632024-12-21T06:17:00.683ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21642024-12-21T06:17:00.685ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
21652024-12-21T06:17:00.685ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 334.085806ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
21662024-12-21T06:17:00.685ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 334.252321ms iteration = 7 status = {}
21672024-12-21T06:17:00.691ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21682024-12-21T06:17:00.691ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21692024-12-21T06:17:00.692ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6266a072-b05f-495e-be0d-c7de8c46452c", "content-length": "372", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} })
21702024-12-21T06:17:00.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21712024-12-21T06:17:00.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21722024-12-21T06:17:00.716ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
21732024-12-21T06:17:00.733ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
21742024-12-21T06:17:00.733ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21752024-12-21T06:17:00.733ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7e814a84-dbcb-4540-8b22-11a2657ce0e3", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} })
21762024-12-21T06:17:00.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21772024-12-21T06:17:00.733ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T06:13:58.796551Z, time_modified: 2024-12-21T06:13:58.796551Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }) }
21782024-12-21T06:17:00.733ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 382.637082ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]}},"default_endpoint":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
21792024-12-21T06:17:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21802024-12-21T06:17:00.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21812024-12-21T06:17:00.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21822024-12-21T06:17:00.738ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21832024-12-21T06:17:00.738ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21842024-12-21T06:17:00.738ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2200b126-0426-45a2-b70f-af5141662060", "content-length": "26", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} })
21852024-12-21T06:17:00.738ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21862024-12-21T06:17:00.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21872024-12-21T06:17:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21882024-12-21T06:17:00.740ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21892024-12-21T06:17:00.752ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
21902024-12-21T06:17:00.752ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21912024-12-21T06:17:00.752ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3fa3c27-8351-4975-91f6-8f1abe16ec29", "content-length": "26", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} })
21922024-12-21T06:17:00.752ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21932024-12-21T06:17:00.754ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
21942024-12-21T06:17:00.797ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21952024-12-21T06:17:00.798ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "82ee325a-10e0-488b-b79f-bb6dbbc778a1", "content-length": "691", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} })
21962024-12-21T06:17:00.798ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
21972024-12-21T06:17:00.798ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
21982024-12-21T06:17:00.798ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
21992024-12-21T06:17:00.799ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 448.130179ms iteration = 7 status = {}
22002024-12-21T06:17:00.801ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22012024-12-21T06:17:00.801ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22022024-12-21T06:17:00.801ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f358ba64-1adf-4487-bb36-ea4dd7308f87", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} })
22032024-12-21T06:17:00.803ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 446.794022ms iteration = 8 status = {}
22042024-12-21T06:17:00.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = aba198fb-f2a6-436c-b920-d520610195fa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
22052024-12-21T06:17:00.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = aba198fb-f2a6-436c-b920-d520610195fa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
22062024-12-21T06:17:00.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = aba198fb-f2a6-436c-b920-d520610195fa response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
22072024-12-21T06:17:00.812ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
22082024-12-21T06:17:00.813ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
22092024-12-21T06:17:00.813ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c032826-77ce-4668-8c9b-e12352e697eb", "content-length": "1", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} })
22102024-12-21T06:17:00.814ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22112024-12-21T06:17:00.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22122024-12-21T06:17:00.816ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 466.000895ms iteration = 7 status = null
22132024-12-21T06:17:00.850ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
22142024-12-21T06:17:00.851ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "84168192-487b-471b-8ac7-47a19bef13ba", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22152024-12-21T06:17:00.851ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22162024-12-21T06:17:00.852ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "676060a7-f138-45a2-b65d-33df2bdecaf5", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22172024-12-21T06:17:00.852ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22182024-12-21T06:17:00.853ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c1eb725d-05bb-4bb4-ad20-742b73b485ad", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22192024-12-21T06:17:00.853ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22202024-12-21T06:17:00.854ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
22212024-12-21T06:17:00.854ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 503.33122ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
22222024-12-21T06:17:00.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22232024-12-21T06:17:00.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22242024-12-21T06:17:00.887ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
22252024-12-21T06:17:00.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22262024-12-21T06:17:00.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22272024-12-21T06:17:00.894ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22282024-12-21T06:17:00.895ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "de011a09-9a4e-430b-87ac-826c257aaabe", "content-length": "134", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} })
22292024-12-21T06:17:00.895ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
22302024-12-21T06:17:00.895ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
22312024-12-21T06:17:00.895ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
22322024-12-21T06:17:00.895ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22332024-12-21T06:17:00.895ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22342024-12-21T06:17:00.895ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22352024-12-21T06:17:00.895ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22362024-12-21T06:17:00.895ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22372024-12-21T06:17:00.895ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
22382024-12-21T06:17:00.895ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
22392024-12-21T06:17:00.895ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
22402024-12-21T06:17:00.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22412024-12-21T06:17:00.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22422024-12-21T06:17:00.897ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22432024-12-21T06:17:00.897ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4040d99d-5f75-4502-af6a-d5212aa0a533", "content-length": "2", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} })
22442024-12-21T06:17:00.897ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22452024-12-21T06:17:00.897ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b65331d-8838-4305-b878-e151fd1c8cdb", "content-length": "52", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} })
22462024-12-21T06:17:00.897ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
22472024-12-21T06:17:00.897ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22482024-12-21T06:17:00.993ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "438181fd-b141-4259-bdc6-37f51dd0716a", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} })
22492024-12-21T06:17:00.993ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
22502024-12-21T06:17:00.993ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22512024-12-21T06:17:00.993ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "775d371b-a7b3-4e16-8547-ff03fd42317d", "content-length": "682", "date": "Sat, 21 Dec 2024 06:17:00 GMT"} })
22522024-12-21T06:17:00.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22532024-12-21T06:17:00.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22542024-12-21T06:17:00.996ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22552024-12-21T06:17:00.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22562024-12-21T06:17:01.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22572024-12-21T06:17:01.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22582024-12-21T06:17:01.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22592024-12-21T06:17:01.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22602024-12-21T06:17:01.008ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 657.67262ms iteration = 7 status = {}
22612024-12-21T06:17:01.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6b260e88-0635-4c8e-9cda-edf59807cf58 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22622024-12-21T06:17:01.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6b260e88-0635-4c8e-9cda-edf59807cf58 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22632024-12-21T06:17:01.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1569 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6b260e88-0635-4c8e-9cda-edf59807cf58 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22642024-12-21T06:17:02.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5ec03cdb-e7a0-4c2d-b29f-3ff4e2082c06 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22652024-12-21T06:17:02.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5ec03cdb-e7a0-4c2d-b29f-3ff4e2082c06 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22662024-12-21T06:17:02.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2544 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5ec03cdb-e7a0-4c2d-b29f-3ff4e2082c06 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22672024-12-21T06:17:03.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 83246aa2-18cb-4aa6-b503-838a0a46642e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22682024-12-21T06:17:03.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 83246aa2-18cb-4aa6-b503-838a0a46642e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22692024-12-21T06:17:03.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 83246aa2-18cb-4aa6-b503-838a0a46642e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22702024-12-21T06:17:03.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1235 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = f4e5d6b1-3def-41a9-b92e-51137eaded75 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
22712024-12-21T06:17:04.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b85823b3-5c71-4933-bd49-cde5acc70136 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22722024-12-21T06:17:04.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b85823b3-5c71-4933-bd49-cde5acc70136 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22732024-12-21T06:17:04.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b85823b3-5c71-4933-bd49-cde5acc70136 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22742024-12-21T06:17:05.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 462efb9c-52e0-41ba-94c5-3f31d008ec6f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22752024-12-21T06:17:05.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 462efb9c-52e0-41ba-94c5-3f31d008ec6f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22762024-12-21T06:17:05.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 462efb9c-52e0-41ba-94c5-3f31d008ec6f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22772024-12-21T06:17:06.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6e32fae5-908b-46b3-85d0-ec0a5de22a7d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22782024-12-21T06:17:06.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6e32fae5-908b-46b3-85d0-ec0a5de22a7d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22792024-12-21T06:17:06.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6e32fae5-908b-46b3-85d0-ec0a5de22a7d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22802024-12-21T06:17:07.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bf8c3b84-d800-4842-aad0-0df6fe8135c4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22812024-12-21T06:17:07.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bf8c3b84-d800-4842-aad0-0df6fe8135c4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22822024-12-21T06:17:07.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bf8c3b84-d800-4842-aad0-0df6fe8135c4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22832024-12-21T06:17:08.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 98a9538d-558a-4bdb-83ee-1c75f86c11ff roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22842024-12-21T06:17:08.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 98a9538d-558a-4bdb-83ee-1c75f86c11ff resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22852024-12-21T06:17:08.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 98a9538d-558a-4bdb-83ee-1c75f86c11ff response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22862024-12-21T06:17:09.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a46e53af-4f20-4061-bd93-82809983d0a0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22872024-12-21T06:17:09.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a46e53af-4f20-4061-bd93-82809983d0a0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22882024-12-21T06:17:09.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a46e53af-4f20-4061-bd93-82809983d0a0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
22892024-12-21T06:17:10.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
22902024-12-21T06:17:10.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22912024-12-21T06:17:10.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22922024-12-21T06:17:10.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
22932024-12-21T06:17:10.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22942024-12-21T06:17:10.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22952024-12-21T06:17:10.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22962024-12-21T06:17:10.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22972024-12-21T06:17:10.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22982024-12-21T06:17:10.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22992024-12-21T06:17:10.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23002024-12-21T06:17:10.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23012024-12-21T06:17:10.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23022024-12-21T06:17:10.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
23032024-12-21T06:17:10.363ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23042024-12-21T06:17:10.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23052024-12-21T06:17:10.376ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
23062024-12-21T06:17:10.376ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.884818ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
23072024-12-21T06:17:10.385ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23082024-12-21T06:17:10.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23092024-12-21T06:17:10.387ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.366549ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23102024-12-21T06:17:10.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b951613f-f219-4e12-a3d8-c37b97920fbe roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23112024-12-21T06:17:10.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b951613f-f219-4e12-a3d8-c37b97920fbe resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23122024-12-21T06:17:10.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b951613f-f219-4e12-a3d8-c37b97920fbe response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23132024-12-21T06:17:11.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8774e155-cf0e-4685-9f15-fb965e7f64ae roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23142024-12-21T06:17:11.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8774e155-cf0e-4685-9f15-fb965e7f64ae resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23152024-12-21T06:17:11.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8774e155-cf0e-4685-9f15-fb965e7f64ae response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23162024-12-21T06:17:12.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e1111e87-6afe-4319-a6d0-0382d9f5cddf roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23172024-12-21T06:17:12.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e1111e87-6afe-4319-a6d0-0382d9f5cddf resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23182024-12-21T06:17:12.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e1111e87-6afe-4319-a6d0-0382d9f5cddf response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23192024-12-21T06:17:13.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1eb4116e-9169-470f-bcef-86c415da2332 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23202024-12-21T06:17:13.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1eb4116e-9169-470f-bcef-86c415da2332 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23212024-12-21T06:17:13.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1eb4116e-9169-470f-bcef-86c415da2332 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23222024-12-21T06:17:13.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1187 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = d6bd8519-c450-4205-ae80-a20954984127 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
23232024-12-21T06:17:14.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78c4ae12-c8f2-4811-9592-f9d59624da45 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23242024-12-21T06:17:14.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78c4ae12-c8f2-4811-9592-f9d59624da45 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23252024-12-21T06:17:14.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78c4ae12-c8f2-4811-9592-f9d59624da45 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23262024-12-21T06:17:15.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0149a210-8439-431b-85ec-92a3e8c1d54e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23272024-12-21T06:17:15.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0149a210-8439-431b-85ec-92a3e8c1d54e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23282024-12-21T06:17:15.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1676 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0149a210-8439-431b-85ec-92a3e8c1d54e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23292024-12-21T06:17:16.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 63589d45-6498-4197-a8ed-27f0d541c221 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23302024-12-21T06:17:16.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 63589d45-6498-4197-a8ed-27f0d541c221 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23312024-12-21T06:17:16.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 63589d45-6498-4197-a8ed-27f0d541c221 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23322024-12-21T06:17:17.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2261e621-9efc-42c8-bfe6-f14c6ecacac2 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23332024-12-21T06:17:17.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2261e621-9efc-42c8-bfe6-f14c6ecacac2 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23342024-12-21T06:17:17.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2261e621-9efc-42c8-bfe6-f14c6ecacac2 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23352024-12-21T06:17:18.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 708ae2c7-c79a-43c2-ad9c-8979f0416713 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23362024-12-21T06:17:18.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 708ae2c7-c79a-43c2-ad9c-8979f0416713 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23372024-12-21T06:17:18.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 708ae2c7-c79a-43c2-ad9c-8979f0416713 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23382024-12-21T06:17:19.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3384440f-2935-4205-beb0-bd273925e21d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23392024-12-21T06:17:19.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3384440f-2935-4205-beb0-bd273925e21d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23402024-12-21T06:17:19.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3384440f-2935-4205-beb0-bd273925e21d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23412024-12-21T06:17:20.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
23422024-12-21T06:17:20.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23432024-12-21T06:17:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23442024-12-21T06:17:20.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
23452024-12-21T06:17:20.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23462024-12-21T06:17:20.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23472024-12-21T06:17:20.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23482024-12-21T06:17:20.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23492024-12-21T06:17:20.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23502024-12-21T06:17:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23512024-12-21T06:17:20.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23522024-12-21T06:17:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23532024-12-21T06:17:20.354ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.794085ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23542024-12-21T06:17:20.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23552024-12-21T06:17:20.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23562024-12-21T06:17:20.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23572024-12-21T06:17:20.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
23582024-12-21T06:17:20.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23592024-12-21T06:17:20.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23602024-12-21T06:17:20.370ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
23612024-12-21T06:17:20.370ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.800499ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
23622024-12-21T06:17:20.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 97e981e2-e660-45d3-af53-90d9a031e60c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23632024-12-21T06:17:20.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 97e981e2-e660-45d3-af53-90d9a031e60c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23642024-12-21T06:17:20.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1869 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 97e981e2-e660-45d3-af53-90d9a031e60c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23652024-12-21T06:17:21.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 56b4eaae-012a-458c-86c8-ca18a405ee97 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23662024-12-21T06:17:21.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 56b4eaae-012a-458c-86c8-ca18a405ee97 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23672024-12-21T06:17:21.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 56b4eaae-012a-458c-86c8-ca18a405ee97 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23682024-12-21T06:17:22.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fe083000-4253-43c2-a446-5fca5152f875 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23692024-12-21T06:17:22.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fe083000-4253-43c2-a446-5fca5152f875 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23702024-12-21T06:17:22.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fe083000-4253-43c2-a446-5fca5152f875 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23712024-12-21T06:17:23.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7c542a2a-ccc1-4bd6-ab81-5a3456ad77d7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23722024-12-21T06:17:23.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7c542a2a-ccc1-4bd6-ab81-5a3456ad77d7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23732024-12-21T06:17:23.822ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7c542a2a-ccc1-4bd6-ab81-5a3456ad77d7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23742024-12-21T06:17:23.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1210 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 21ead863-81c6-4796-a0b3-7c348ad88f9f response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
23752024-12-21T06:17:24.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 62fc5d8d-d7b9-432e-a834-2e8502c8412c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23762024-12-21T06:17:24.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 62fc5d8d-d7b9-432e-a834-2e8502c8412c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23772024-12-21T06:17:24.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 62fc5d8d-d7b9-432e-a834-2e8502c8412c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23782024-12-21T06:17:25.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f5eff899-d9eb-4802-bc69-76370a13c084 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23792024-12-21T06:17:25.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f5eff899-d9eb-4802-bc69-76370a13c084 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23802024-12-21T06:17:25.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f5eff899-d9eb-4802-bc69-76370a13c084 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23812024-12-21T06:17:26.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a731c9e1-e10c-40b5-ac46-f8958d005059 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23822024-12-21T06:17:26.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a731c9e1-e10c-40b5-ac46-f8958d005059 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23832024-12-21T06:17:26.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a731c9e1-e10c-40b5-ac46-f8958d005059 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23842024-12-21T06:17:27.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9d27611e-a655-4790-a283-ad52e45092b2 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23852024-12-21T06:17:27.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9d27611e-a655-4790-a283-ad52e45092b2 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23862024-12-21T06:17:27.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9d27611e-a655-4790-a283-ad52e45092b2 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23872024-12-21T06:17:28.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = aafb352b-4b76-498b-872a-1dff46c524c9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23882024-12-21T06:17:28.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = aafb352b-4b76-498b-872a-1dff46c524c9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23892024-12-21T06:17:28.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = aafb352b-4b76-498b-872a-1dff46c524c9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23902024-12-21T06:17:29.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 766cbc6e-9747-43fa-a1f9-9d44f256a75b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23912024-12-21T06:17:29.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 766cbc6e-9747-43fa-a1f9-9d44f256a75b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23922024-12-21T06:17:29.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1584 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 766cbc6e-9747-43fa-a1f9-9d44f256a75b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
23932024-12-21T06:17:30.350ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
23942024-12-21T06:17:30.350ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23952024-12-21T06:17:30.350ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
23962024-12-21T06:17:30.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
23972024-12-21T06:17:30.350ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23982024-12-21T06:17:30.350ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
23992024-12-21T06:17:30.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24002024-12-21T06:17:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24012024-12-21T06:17:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24022024-12-21T06:17:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24032024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
24042024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
24052024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
24062024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
24072024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24082024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
24092024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24102024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
24112024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24122024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
24132024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24142024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
24152024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24162024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
24172024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24182024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
24192024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24202024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24212024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24222024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24232024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24242024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24252024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24262024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24272024-12-21T06:17:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24282024-12-21T06:17:30.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24292024-12-21T06:17:30.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1181, tv_nsec: 437771998 } })
24302024-12-21T06:17:30.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1181, tv_nsec: 437935253 } })
24312024-12-21T06:17:30.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
24322024-12-21T06:17:30.353ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24332024-12-21T06:17:30.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
24342024-12-21T06:17:30.354ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.097094ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24352024-12-21T06:17:30.355ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24362024-12-21T06:17:30.355ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24372024-12-21T06:17:30.355ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24382024-12-21T06:17:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24392024-12-21T06:17:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24402024-12-21T06:17:30.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24412024-12-21T06:17:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24422024-12-21T06:17:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24432024-12-21T06:17:30.355ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24442024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24452024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
24462024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
24472024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
24482024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24492024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
24502024-12-21T06:17:30.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
24512024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24522024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
24532024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24542024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
24552024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24562024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24572024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24582024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24592024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24602024-12-21T06:17:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24612024-12-21T06:17:30.358ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24622024-12-21T06:17:30.358ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24632024-12-21T06:17:30.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24642024-12-21T06:17:30.358ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24652024-12-21T06:17:30.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24662024-12-21T06:17:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24672024-12-21T06:17:30.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24682024-12-21T06:17:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24692024-12-21T06:17:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24702024-12-21T06:17:30.361ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24712024-12-21T06:17:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
24722024-12-21T06:17:30.361ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24732024-12-21T06:17:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24742024-12-21T06:17:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24752024-12-21T06:17:30.363ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24762024-12-21T06:17:30.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24772024-12-21T06:17:30.364ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24782024-12-21T06:17:30.366ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24792024-12-21T06:17:30.366ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24802024-12-21T06:17:30.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24812024-12-21T06:17:30.366ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 15.522811ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24822024-12-21T06:17:30.368ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24832024-12-21T06:17:30.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24842024-12-21T06:17:30.369ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1181, tv_nsec: 453652309 } })
24852024-12-21T06:17:30.369ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
24862024-12-21T06:17:30.369ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
24872024-12-21T06:17:30.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24882024-12-21T06:17:30.369ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24892024-12-21T06:17:30.370ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
24902024-12-21T06:17:30.370ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24912024-12-21T06:17:30.370ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 18.671958ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
24922024-12-21T06:17:30.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24932024-12-21T06:17:30.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24942024-12-21T06:17:30.373ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24952024-12-21T06:17:30.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24962024-12-21T06:17:30.374ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
24972024-12-21T06:17:30.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24982024-12-21T06:17:30.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24992024-12-21T06:17:30.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25002024-12-21T06:17:30.375ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25012024-12-21T06:17:30.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25022024-12-21T06:17:30.377ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25032024-12-21T06:17:30.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25042024-12-21T06:17:30.387ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
25052024-12-21T06:17:30.387ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 37.408558ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
25062024-12-21T06:17:30.396ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25072024-12-21T06:17:30.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25082024-12-21T06:17:30.396ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25092024-12-21T06:17:30.396ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25102024-12-21T06:17:30.396ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25112024-12-21T06:17:30.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25122024-12-21T06:17:30.399ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25132024-12-21T06:17:30.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25142024-12-21T06:17:30.402ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.956014ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
25152024-12-21T06:17:30.411ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
25162024-12-21T06:17:30.411ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25172024-12-21T06:17:30.412ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac8f6357-22ba-4a27-a9d4-a2055578c524", "content-length": "26", "date": "Sat, 21 Dec 2024 06:17:30 GMT"} })
25182024-12-21T06:17:30.412ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25192024-12-21T06:17:30.414ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25202024-12-21T06:17:30.414ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 63.213223ms iteration = 11 status = {"physical_disks_added":0}
25212024-12-21T06:17:30.419ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25222024-12-21T06:17:30.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25232024-12-21T06:17:30.432ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
25242024-12-21T06:17:30.432ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25252024-12-21T06:17:30.432ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eade942a-84f8-4599-8363-eb54dcacc6f2", "content-length": "26", "date": "Sat, 21 Dec 2024 06:17:30 GMT"} })
25262024-12-21T06:17:30.432ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25272024-12-21T06:17:30.434ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25282024-12-21T06:17:30.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.055088ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25292024-12-21T06:17:30.438ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.119396ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25302024-12-21T06:17:30.439ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25312024-12-21T06:17:30.439ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25322024-12-21T06:17:30.439ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 87.898087ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25332024-12-21T06:17:30.474ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
25342024-12-21T06:17:30.474ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25352024-12-21T06:17:30.474ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d464c59-c536-4dff-8462-ffab8340c5d7", "content-length": "26", "date": "Sat, 21 Dec 2024 06:17:30 GMT"} })
25362024-12-21T06:17:30.474ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25372024-12-21T06:17:30.476ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
25382024-12-21T06:17:30.483ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25392024-12-21T06:17:30.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25402024-12-21T06:17:30.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 136.012702ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
25412024-12-21T06:17:30.523ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25422024-12-21T06:17:30.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25432024-12-21T06:17:30.558ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
25442024-12-21T06:17:30.558ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25452024-12-21T06:17:30.559ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5e1fa78-8ef7-4ad5-90e3-b58eee2d80f4", "content-length": "372", "date": "Sat, 21 Dec 2024 06:17:30 GMT"} })
25462024-12-21T06:17:30.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25472024-12-21T06:17:30.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25482024-12-21T06:17:30.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25492024-12-21T06:17:30.562ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25502024-12-21T06:17:30.562ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25512024-12-21T06:17:30.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25522024-12-21T06:17:30.563ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25532024-12-21T06:17:30.565ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25542024-12-21T06:17:30.565ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25552024-12-21T06:17:30.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25562024-12-21T06:17:30.587ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25572024-12-21T06:17:30.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25582024-12-21T06:17:30.588ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 231.614744ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
25592024-12-21T06:17:30.588ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25602024-12-21T06:17:30.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25612024-12-21T06:17:30.590ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25622024-12-21T06:17:30.593ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
25632024-12-21T06:17:30.593ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25642024-12-21T06:17:30.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25652024-12-21T06:17:30.594ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 243.414711ms iteration = 8 status = 0
25662024-12-21T06:17:30.601ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
25672024-12-21T06:17:30.601ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25682024-12-21T06:17:30.601ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1591acc4-d0d8-48eb-83a5-cbabdd8f5409", "date": "Sat, 21 Dec 2024 06:17:30 GMT"} })
25692024-12-21T06:17:30.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25702024-12-21T06:17:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25712024-12-21T06:17:30.623ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 273.195507ms iteration = 8 status = {}
25722024-12-21T06:17:30.630ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
25732024-12-21T06:17:30.631ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a10aa8b5-e7d7-4f11-af5c-8ca0e46454e9", "content-length": "1", "date": "Sat, 21 Dec 2024 06:17:30 GMT"} })
25742024-12-21T06:17:30.632ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
25752024-12-21T06:17:30.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
25762024-12-21T06:17:30.642ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
25772024-12-21T06:17:30.643ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "85adacfd-60a0-4791-b030-a5d5cc41df7f", "content-length": "691", "date": "Sat, 21 Dec 2024 06:17:30 GMT"} })
25782024-12-21T06:17:30.643ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
25792024-12-21T06:17:30.643ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
25802024-12-21T06:17:30.643ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
25812024-12-21T06:17:30.643ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 292.323868ms iteration = 8 status = {}
25822024-12-21T06:17:30.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25832024-12-21T06:17:30.644ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 294.670473ms iteration = 8 status = null
25842024-12-21T06:17:30.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25852024-12-21T06:17:30.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25862024-12-21T06:17:30.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25872024-12-21T06:17:30.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25882024-12-21T06:17:30.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25892024-12-21T06:17:30.682ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
25902024-12-21T06:17:30.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25912024-12-21T06:17:30.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25922024-12-21T06:17:30.689ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25932024-12-21T06:17:30.689ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "50250605-53ea-49f0-8d2e-29174199f46a", "content-length": "134", "date": "Sat, 21 Dec 2024 06:17:30 GMT"} })
25942024-12-21T06:17:30.689ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
25952024-12-21T06:17:30.689ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
25962024-12-21T06:17:30.689ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25972024-12-21T06:17:30.689ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25982024-12-21T06:17:30.689ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25992024-12-21T06:17:30.689ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26002024-12-21T06:17:30.689ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26012024-12-21T06:17:30.689ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26022024-12-21T06:17:30.690ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
26032024-12-21T06:17:30.690ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
26042024-12-21T06:17:30.690ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
26052024-12-21T06:17:30.690ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26062024-12-21T06:17:30.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26072024-12-21T06:17:30.691ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26082024-12-21T06:17:30.691ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0387b3e1-8a38-4ee2-9a62-608c5fa88dad", "content-length": "2", "date": "Sat, 21 Dec 2024 06:17:30 GMT"} })
26092024-12-21T06:17:30.691ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26102024-12-21T06:17:30.691ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f622dd9-da31-4bbb-833c-d475670f3096", "content-length": "52", "date": "Sat, 21 Dec 2024 06:17:30 GMT"} })
26112024-12-21T06:17:30.691ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
26122024-12-21T06:17:30.691ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26132024-12-21T06:17:30.756ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26142024-12-21T06:17:30.756ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26152024-12-21T06:17:30.782ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b488b0d9-645d-4b9c-89a3-4207158419b2", "date": "Sat, 21 Dec 2024 06:17:30 GMT"} })
26162024-12-21T06:17:30.782ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
26172024-12-21T06:17:30.782ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26182024-12-21T06:17:30.782ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0fb46a65-f0a7-44a9-a244-1ce645e87bda", "date": "Sat, 21 Dec 2024 06:17:30 GMT"} })
26192024-12-21T06:17:30.784ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 428.260808ms iteration = 9 status = {}
26202024-12-21T06:17:30.784ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "60383c2b-a3b6-4c4e-9dbd-faddd0c8fcd8", "content-length": "682", "date": "Sat, 21 Dec 2024 06:17:30 GMT"} })
26212024-12-21T06:17:30.784ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26222024-12-21T06:17:30.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26232024-12-21T06:17:30.787ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26242024-12-21T06:17:30.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26252024-12-21T06:17:30.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26262024-12-21T06:17:30.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26272024-12-21T06:17:30.791ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26282024-12-21T06:17:30.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26292024-12-21T06:17:30.798ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 447.151192ms iteration = 8 status = {}
26302024-12-21T06:17:30.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = bf358eb8-90cf-4cfb-a9ee-a8240f09c7e6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
26312024-12-21T06:17:30.842ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = bf358eb8-90cf-4cfb-a9ee-a8240f09c7e6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
26322024-12-21T06:17:30.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3637 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = bf358eb8-90cf-4cfb-a9ee-a8240f09c7e6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
26332024-12-21T06:17:30.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 43866f7e-9379-4969-aa2c-181a9b22f420 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26342024-12-21T06:17:30.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 43866f7e-9379-4969-aa2c-181a9b22f420 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26352024-12-21T06:17:30.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 43866f7e-9379-4969-aa2c-181a9b22f420 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26362024-12-21T06:17:31.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 783b9141-ea13-47a2-983f-7f045c91875d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26372024-12-21T06:17:31.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 783b9141-ea13-47a2-983f-7f045c91875d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26382024-12-21T06:17:31.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 783b9141-ea13-47a2-983f-7f045c91875d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26392024-12-21T06:17:33.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 773042b1-c2b9-492e-9338-272a858ebd98 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26402024-12-21T06:17:33.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 773042b1-c2b9-492e-9338-272a858ebd98 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26412024-12-21T06:17:33.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2322 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 773042b1-c2b9-492e-9338-272a858ebd98 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26422024-12-21T06:17:33.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1192 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = d6df652c-41c7-434f-bdd1-09c3420d3522 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
26432024-12-21T06:17:34.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d610bffe-d01d-4a63-815f-c0023c1e155f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26442024-12-21T06:17:34.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d610bffe-d01d-4a63-815f-c0023c1e155f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26452024-12-21T06:17:34.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d610bffe-d01d-4a63-815f-c0023c1e155f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26462024-12-21T06:17:35.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 66d3b7e7-9317-4a67-b0e9-70aa04e77412 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26472024-12-21T06:17:35.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 66d3b7e7-9317-4a67-b0e9-70aa04e77412 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26482024-12-21T06:17:35.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 66d3b7e7-9317-4a67-b0e9-70aa04e77412 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26492024-12-21T06:17:36.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1011f844-96ed-40b5-806f-2cf29dee9d40 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26502024-12-21T06:17:36.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1011f844-96ed-40b5-806f-2cf29dee9d40 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26512024-12-21T06:17:36.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1011f844-96ed-40b5-806f-2cf29dee9d40 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26522024-12-21T06:17:37.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e3acbf1-384a-41d0-954c-e5036e8c2d97 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26532024-12-21T06:17:37.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e3acbf1-384a-41d0-954c-e5036e8c2d97 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26542024-12-21T06:17:37.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2702 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e3acbf1-384a-41d0-954c-e5036e8c2d97 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26552024-12-21T06:17:38.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = af5a50db-c95e-4187-b2aa-d7d1eb9293aa roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26562024-12-21T06:17:38.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = af5a50db-c95e-4187-b2aa-d7d1eb9293aa resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26572024-12-21T06:17:38.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = af5a50db-c95e-4187-b2aa-d7d1eb9293aa response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26582024-12-21T06:17:39.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cc03d1c0-dd6b-425d-b9d2-b238d0def2cf roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26592024-12-21T06:17:39.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cc03d1c0-dd6b-425d-b9d2-b238d0def2cf resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26602024-12-21T06:17:39.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1971 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cc03d1c0-dd6b-425d-b9d2-b238d0def2cf response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26612024-12-21T06:17:40.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6c0ac827-1fef-47db-a568-d3ebaa878a04 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26622024-12-21T06:17:40.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6c0ac827-1fef-47db-a568-d3ebaa878a04 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26632024-12-21T06:17:40.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6c0ac827-1fef-47db-a568-d3ebaa878a04 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26642024-12-21T06:17:40.351ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
26652024-12-21T06:17:40.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26662024-12-21T06:17:40.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26672024-12-21T06:17:40.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
26682024-12-21T06:17:40.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26692024-12-21T06:17:40.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26702024-12-21T06:17:40.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26712024-12-21T06:17:40.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26722024-12-21T06:17:40.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26732024-12-21T06:17:40.355ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.704603ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26742024-12-21T06:17:40.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26752024-12-21T06:17:40.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26762024-12-21T06:17:40.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26772024-12-21T06:17:40.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26782024-12-21T06:17:40.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26792024-12-21T06:17:40.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26802024-12-21T06:17:40.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
26812024-12-21T06:17:40.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26822024-12-21T06:17:40.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26832024-12-21T06:17:40.373ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
26842024-12-21T06:17:40.373ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.199596ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
26852024-12-21T06:17:41.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 892c9573-ea3e-4284-b20b-0b57055e6043 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26862024-12-21T06:17:41.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 892c9573-ea3e-4284-b20b-0b57055e6043 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26872024-12-21T06:17:41.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 892c9573-ea3e-4284-b20b-0b57055e6043 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26882024-12-21T06:17:42.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a0a3e0b8-15bc-4fee-8dd3-4842d3eca818 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26892024-12-21T06:17:42.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a0a3e0b8-15bc-4fee-8dd3-4842d3eca818 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26902024-12-21T06:17:42.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a0a3e0b8-15bc-4fee-8dd3-4842d3eca818 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26912024-12-21T06:17:43.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 914c90df-6063-4e9f-8147-becd82e9ba38 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26922024-12-21T06:17:43.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 914c90df-6063-4e9f-8147-becd82e9ba38 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26932024-12-21T06:17:43.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 914c90df-6063-4e9f-8147-becd82e9ba38 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
26942024-12-21T06:17:43.942ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:33656
26952024-12-21T06:17:43.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33656 req_id = 8559e6af-2db5-4a70-9c03-4290a19245d4 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
26962024-12-21T06:17:43.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33656 req_id = 8559e6af-2db5-4a70-9c03-4290a19245d4 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
26972024-12-21T06:17:43.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33656 req_id = 8559e6af-2db5-4a70-9c03-4290a19245d4 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
26982024-12-21T06:17:43.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33656 req_id = ff73e015-dfde-4ece-b065-b02189b95da9 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
26992024-12-21T06:17:43.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33656 req_id = ff73e015-dfde-4ece-b065-b02189b95da9 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
27002024-12-21T06:17:43.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33656 req_id = ff73e015-dfde-4ece-b065-b02189b95da9 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
27012024-12-21T06:17:43.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1345 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 0b9232b3-473d-4e09-94da-2c6e084c63fc response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
27022024-12-21T06:17:44.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f5332e60-0e60-43b1-bd74-1b3270f8f634 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27032024-12-21T06:17:44.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f5332e60-0e60-43b1-bd74-1b3270f8f634 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27042024-12-21T06:17:44.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f5332e60-0e60-43b1-bd74-1b3270f8f634 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27052024-12-21T06:17:45.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9b8b4a46-5db4-431c-b4a1-c6831fb29460 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27062024-12-21T06:17:45.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9b8b4a46-5db4-431c-b4a1-c6831fb29460 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27072024-12-21T06:17:45.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2606 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9b8b4a46-5db4-431c-b4a1-c6831fb29460 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27082024-12-21T06:17:46.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 50bc4f43-2bc1-4e63-93b8-60a3ef431d8c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27092024-12-21T06:17:46.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 50bc4f43-2bc1-4e63-93b8-60a3ef431d8c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27102024-12-21T06:17:46.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 50bc4f43-2bc1-4e63-93b8-60a3ef431d8c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27112024-12-21T06:17:47.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = add8a280-2245-45ba-87f6-13ede8a264d1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27122024-12-21T06:17:47.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = add8a280-2245-45ba-87f6-13ede8a264d1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27132024-12-21T06:17:47.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = add8a280-2245-45ba-87f6-13ede8a264d1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27142024-12-21T06:17:48.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2d83e44a-fd3b-4cc9-98ae-866a895cd629 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27152024-12-21T06:17:48.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2d83e44a-fd3b-4cc9-98ae-866a895cd629 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27162024-12-21T06:17:48.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2d83e44a-fd3b-4cc9-98ae-866a895cd629 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27172024-12-21T06:17:49.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a4423770-73f6-408d-936d-38032e195496 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27182024-12-21T06:17:49.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a4423770-73f6-408d-936d-38032e195496 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27192024-12-21T06:17:49.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a4423770-73f6-408d-936d-38032e195496 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27202024-12-21T06:17:50.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
27212024-12-21T06:17:50.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27222024-12-21T06:17:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27232024-12-21T06:17:50.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
27242024-12-21T06:17:50.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27252024-12-21T06:17:50.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27262024-12-21T06:17:50.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27272024-12-21T06:17:50.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27282024-12-21T06:17:50.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27292024-12-21T06:17:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27302024-12-21T06:17:50.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27312024-12-21T06:17:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27322024-12-21T06:17:50.355ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.074363ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27332024-12-21T06:17:50.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27342024-12-21T06:17:50.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27352024-12-21T06:17:50.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27362024-12-21T06:17:50.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
27372024-12-21T06:17:50.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27382024-12-21T06:17:50.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27392024-12-21T06:17:50.370ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
27402024-12-21T06:17:50.370ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.18817ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
27412024-12-21T06:17:50.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b3d80c61-1bd9-4a33-9d89-9179e0849605 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27422024-12-21T06:17:50.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b3d80c61-1bd9-4a33-9d89-9179e0849605 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27432024-12-21T06:17:50.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b3d80c61-1bd9-4a33-9d89-9179e0849605 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27442024-12-21T06:17:51.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9769314a-9ada-4181-8dc9-35b0b796baed roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27452024-12-21T06:17:51.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9769314a-9ada-4181-8dc9-35b0b796baed resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27462024-12-21T06:17:51.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9769314a-9ada-4181-8dc9-35b0b796baed response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27472024-12-21T06:17:52.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bc072e98-6370-4871-bc84-382009bae1bf roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27482024-12-21T06:17:52.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bc072e98-6370-4871-bc84-382009bae1bf resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27492024-12-21T06:17:52.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bc072e98-6370-4871-bc84-382009bae1bf response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27502024-12-21T06:17:53.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d9c3173a-4560-40db-8156-d2ec7979b1f5 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27512024-12-21T06:17:53.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d9c3173a-4560-40db-8156-d2ec7979b1f5 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27522024-12-21T06:17:53.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d9c3173a-4560-40db-8156-d2ec7979b1f5 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27532024-12-21T06:17:53.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1311 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 008b1ed2-0ee8-4e6b-8a4a-27a7e946cd6d response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
27542024-12-21T06:17:54.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 51783726-d69a-4da8-bcc6-c3d469aff63b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27552024-12-21T06:17:54.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 51783726-d69a-4da8-bcc6-c3d469aff63b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27562024-12-21T06:17:54.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 51783726-d69a-4da8-bcc6-c3d469aff63b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27572024-12-21T06:17:55.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 12561f6d-10d0-414b-a816-71f672077698 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27582024-12-21T06:17:55.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 12561f6d-10d0-414b-a816-71f672077698 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27592024-12-21T06:17:55.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 12561f6d-10d0-414b-a816-71f672077698 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27602024-12-21T06:17:56.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bf9dfe71-2236-494b-a914-a1239263e093 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27612024-12-21T06:17:56.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bf9dfe71-2236-494b-a914-a1239263e093 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27622024-12-21T06:17:56.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bf9dfe71-2236-494b-a914-a1239263e093 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27632024-12-21T06:17:57.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9c934611-b726-4b8b-b1d4-6f7eb5694786 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27642024-12-21T06:17:57.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9c934611-b726-4b8b-b1d4-6f7eb5694786 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27652024-12-21T06:17:57.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9c934611-b726-4b8b-b1d4-6f7eb5694786 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27662024-12-21T06:17:58.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ebb27887-ae82-423e-bf5f-98be14765308 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27672024-12-21T06:17:58.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ebb27887-ae82-423e-bf5f-98be14765308 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27682024-12-21T06:17:58.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ebb27887-ae82-423e-bf5f-98be14765308 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27692024-12-21T06:17:59.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cbda4094-76a7-45cf-843c-0964922b6dcf roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27702024-12-21T06:17:59.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cbda4094-76a7-45cf-843c-0964922b6dcf resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27712024-12-21T06:17:59.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cbda4094-76a7-45cf-843c-0964922b6dcf response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
27722024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
27732024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27742024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
27752024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
27762024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
27772024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
27782024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
27792024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
27802024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27812024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27822024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
27832024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
27842024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
27852024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
27862024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
27872024-12-21T06:18:00.350ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 7c419228-2431-4394-af83-ea0457364b70
27882024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.331\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"7c419228-2431-4394-af83-ea0457364b70"}
27892024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
27902024-12-21T06:18:00.350ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 06:08:00.350342849 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
27912024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
27922024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
27932024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
27942024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
27952024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
27962024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
27972024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
27982024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27992024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28002024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28012024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
28022024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28032024-12-21T06:18:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28042024-12-21T06:18:00.350ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1211, tv_nsec: 435306200 } })
28052024-12-21T06:18:00.350ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("068965c6-3480-4953-b57e-dd969abb2a21.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("45c0a855-5592-491c-b7b3-470902319db2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1211, tv_nsec: 435350931 } })
28062024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
28072024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
28082024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28092024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28102024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28112024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
28122024-12-21T06:18:00.351ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
28132024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
28142024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28152024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28162024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
28172024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
28182024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
28192024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
28202024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28212024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28222024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
28232024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28242024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
28252024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28262024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
28272024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28282024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28292024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
28302024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
28312024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28322024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.232634ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
28332024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28342024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28352024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28362024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
28372024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
28382024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.269255ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
28392024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28402024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28412024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28422024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
28432024-12-21T06:18:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28442024-12-21T06:18:00.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1211, tv_nsec: 437895411 } })
28452024-12-21T06:18:00.353ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28462024-12-21T06:18:00.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
28472024-12-21T06:18:00.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1211, tv_nsec: 438453467 } })
28482024-12-21T06:18:00.354ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.062423ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
28492024-12-21T06:18:00.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
28502024-12-21T06:18:00.354ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28512024-12-21T06:18:00.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28522024-12-21T06:18:00.355ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 06:08:00.350342849 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
28532024-12-21T06:18:00.355ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.775992ms iteration = 5 status = {"expiration":"2024-12-21T06:08:00.350342849Z","pruned":[]}
28542024-12-21T06:18:00.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28552024-12-21T06:18:00.355ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
28562024-12-21T06:18:00.355ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28572024-12-21T06:18:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28582024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
28592024-12-21T06:18:00.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28602024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
28612024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28622024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
28632024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28642024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28652024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
28662024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28672024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
28682024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
28692024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
28702024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
28712024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28722024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
28732024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
28742024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28752024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
28762024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
28772024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28782024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28792024-12-21T06:18:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
28802024-12-21T06:18:00.357ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28812024-12-21T06:18:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28822024-12-21T06:18:00.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28832024-12-21T06:18:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28842024-12-21T06:18:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28852024-12-21T06:18:00.360ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28862024-12-21T06:18:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28872024-12-21T06:18:00.360ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28882024-12-21T06:18:00.361ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28892024-12-21T06:18:00.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
28902024-12-21T06:18:00.362ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28912024-12-21T06:18:00.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
28922024-12-21T06:18:00.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28932024-12-21T06:18:00.364ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28942024-12-21T06:18:00.364ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28952024-12-21T06:18:00.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28962024-12-21T06:18:00.366ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28972024-12-21T06:18:00.366ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28982024-12-21T06:18:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
28992024-12-21T06:18:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29002024-12-21T06:18:00.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29012024-12-21T06:18:00.368ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.116346ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
29022024-12-21T06:18:00.368ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
29032024-12-21T06:18:00.368ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
29042024-12-21T06:18:00.368ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
29052024-12-21T06:18:00.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29062024-12-21T06:18:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29072024-12-21T06:18:00.369ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29082024-12-21T06:18:00.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29092024-12-21T06:18:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29102024-12-21T06:18:00.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
29112024-12-21T06:18:00.373ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 17.000392ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
29122024-12-21T06:18:00.374ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29132024-12-21T06:18:00.374ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29142024-12-21T06:18:00.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29152024-12-21T06:18:00.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29162024-12-21T06:18:00.374ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29172024-12-21T06:18:00.374ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29182024-12-21T06:18:00.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29192024-12-21T06:18:00.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29202024-12-21T06:18:00.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29212024-12-21T06:18:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
29222024-12-21T06:18:00.378ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29232024-12-21T06:18:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29242024-12-21T06:18:00.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29252024-12-21T06:18:00.379ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29262024-12-21T06:18:00.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29272024-12-21T06:18:00.380ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29282024-12-21T06:18:00.380ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29292024-12-21T06:18:00.380ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29302024-12-21T06:18:00.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29312024-12-21T06:18:00.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29322024-12-21T06:18:00.383ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29332024-12-21T06:18:00.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29342024-12-21T06:18:00.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29352024-12-21T06:18:00.390ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
29362024-12-21T06:18:00.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29372024-12-21T06:18:00.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29382024-12-21T06:18:00.393ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29392024-12-21T06:18:00.393ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29402024-12-21T06:18:00.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29412024-12-21T06:18:00.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29422024-12-21T06:18:00.395ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29432024-12-21T06:18:00.395ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29442024-12-21T06:18:00.395ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29452024-12-21T06:18:00.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29462024-12-21T06:18:00.399ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29472024-12-21T06:18:00.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29482024-12-21T06:18:00.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29492024-12-21T06:18:00.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29502024-12-21T06:18:00.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29512024-12-21T06:18:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29522024-12-21T06:18:00.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29532024-12-21T06:18:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29542024-12-21T06:18:00.411ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29552024-12-21T06:18:00.411ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29562024-12-21T06:18:00.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29572024-12-21T06:18:00.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29582024-12-21T06:18:00.413ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
29592024-12-21T06:18:00.413ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
29602024-12-21T06:18:00.413ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
29612024-12-21T06:18:00.413ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29622024-12-21T06:18:00.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29632024-12-21T06:18:00.413ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.725209ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29642024-12-21T06:18:00.414ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
29652024-12-21T06:18:00.414ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
29662024-12-21T06:18:00.414ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 57.800632ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
29672024-12-21T06:18:00.415ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29682024-12-21T06:18:00.415ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1211, tv_nsec: 499854220 } })
29692024-12-21T06:18:00.415ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
29702024-12-21T06:18:00.416ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29712024-12-21T06:18:00.416ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 64.946211ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29722024-12-21T06:18:00.416ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29732024-12-21T06:18:00.416ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.326144ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
29742024-12-21T06:18:00.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29752024-12-21T06:18:00.417ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
29762024-12-21T06:18:00.417ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
29772024-12-21T06:18:00.417ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 66.384041ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
29782024-12-21T06:18:00.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.499392ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29792024-12-21T06:18:00.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
29802024-12-21T06:18:00.419ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29812024-12-21T06:18:00.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29822024-12-21T06:18:00.420ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
29832024-12-21T06:18:00.420ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.67001ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
29842024-12-21T06:18:00.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29852024-12-21T06:18:00.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29862024-12-21T06:18:00.425ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29872024-12-21T06:18:00.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29882024-12-21T06:18:00.427ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29892024-12-21T06:18:00.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29902024-12-21T06:18:00.429ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29912024-12-21T06:18:00.431ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
29922024-12-21T06:18:00.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
29932024-12-21T06:18:00.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
29942024-12-21T06:18:00.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29952024-12-21T06:18:00.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29962024-12-21T06:18:00.435ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
29972024-12-21T06:18:00.435ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
29982024-12-21T06:18:00.435ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29992024-12-21T06:18:00.435ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.848816ms iteration = 9 status = 0
30002024-12-21T06:18:00.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30012024-12-21T06:18:00.435ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30022024-12-21T06:18:00.435ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30032024-12-21T06:18:00.435ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 84.453092ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30042024-12-21T06:18:00.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30052024-12-21T06:18:00.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30062024-12-21T06:18:00.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30072024-12-21T06:18:00.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30082024-12-21T06:18:00.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30092024-12-21T06:18:00.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30102024-12-21T06:18:00.439ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30112024-12-21T06:18:00.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
30122024-12-21T06:18:00.441ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30132024-12-21T06:18:00.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30142024-12-21T06:18:00.441ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
30152024-12-21T06:18:00.441ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
30162024-12-21T06:18:00.441ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 06:14:07.931887 UTC dns_group = internal generation = 1
30172024-12-21T06:18:00.441ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 91.57445ms iteration = 6 status = {"generation":1}
30182024-12-21T06:18:00.442ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30192024-12-21T06:18:00.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30202024-12-21T06:18:00.443ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 92.401873ms iteration = 12 status = {"physical_disks_added":0}
30212024-12-21T06:18:00.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 88.631808ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
30222024-12-21T06:18:00.449ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
30232024-12-21T06:18:00.449ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 0 version = 2
30242024-12-21T06:18:00.449ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30252024-12-21T06:18:00.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30262024-12-21T06:18:00.451ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30272024-12-21T06:18:00.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30282024-12-21T06:18:00.454ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30292024-12-21T06:18:00.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30302024-12-21T06:18:00.454ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.665947ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30312024-12-21T06:18:00.455ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 1 version = 2
30322024-12-21T06:18:00.455ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
30332024-12-21T06:18:00.455ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 06:14:08.776888 UTC dns_group = external generation = 2
30342024-12-21T06:18:00.455ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 105.564808ms iteration = 6 status = {"generation":2}
30352024-12-21T06:18:00.484ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
30362024-12-21T06:18:00.485ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30372024-12-21T06:18:00.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30382024-12-21T06:18:00.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30392024-12-21T06:18:00.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30402024-12-21T06:18:00.495ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
30412024-12-21T06:18:00.495ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 144.418925ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
30422024-12-21T06:18:00.496ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30432024-12-21T06:18:00.497ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30442024-12-21T06:18:00.497ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30452024-12-21T06:18:00.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30462024-12-21T06:18:00.499ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30472024-12-21T06:18:00.500ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30482024-12-21T06:18:00.500ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30492024-12-21T06:18:00.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30502024-12-21T06:18:00.502ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
30512024-12-21T06:18:00.512ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
30522024-12-21T06:18:00.512ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30532024-12-21T06:18:00.512ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "78c8d576-e01c-4c5e-9d8b-b51e443002df", "content-length": "26", "date": "Sat, 21 Dec 2024 06:18:00 GMT"} })
30542024-12-21T06:18:00.512ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30552024-12-21T06:18:00.513ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30562024-12-21T06:18:00.530ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
30572024-12-21T06:18:00.530ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30582024-12-21T06:18:00.530ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a879de27-23b6-4728-896b-5d346efb9302", "content-length": "26", "date": "Sat, 21 Dec 2024 06:18:00 GMT"} })
30592024-12-21T06:18:00.530ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30602024-12-21T06:18:00.532ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30612024-12-21T06:18:00.566ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T06:13:58.796551Z, time_modified: 2024-12-21T06:13:58.796551Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }) }
30622024-12-21T06:18:00.566ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 216.31151ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]}},"default_endpoint":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
30632024-12-21T06:18:00.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0d33fbde-6220-4a06-96bd-77b7c3384558 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
30642024-12-21T06:18:00.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0d33fbde-6220-4a06-96bd-77b7c3384558 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
30652024-12-21T06:18:00.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0d33fbde-6220-4a06-96bd-77b7c3384558 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
30662024-12-21T06:18:00.638ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30672024-12-21T06:18:00.638ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30682024-12-21T06:18:00.639ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6423662f-22e5-4321-be5e-beb41395e576", "content-length": "372", "date": "Sat, 21 Dec 2024 06:18:00 GMT"} })
30692024-12-21T06:18:00.639ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30702024-12-21T06:18:00.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30712024-12-21T06:18:00.646ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
30722024-12-21T06:18:00.652ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
30732024-12-21T06:18:00.652ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30742024-12-21T06:18:00.652ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c42bca01-e088-4615-88bb-b4461675da60", "content-length": "26", "date": "Sat, 21 Dec 2024 06:18:00 GMT"} })
30752024-12-21T06:18:00.652ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30762024-12-21T06:18:00.654ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
30772024-12-21T06:18:00.655ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
30782024-12-21T06:18:00.655ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30792024-12-21T06:18:00.655ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9df511bd-eeb1-4fb4-b816-fcd048607e8d", "date": "Sat, 21 Dec 2024 06:18:00 GMT"} })
30802024-12-21T06:18:00.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30812024-12-21T06:18:00.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30822024-12-21T06:18:00.659ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
30832024-12-21T06:18:00.659ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3e8b211a-8f4f-4a40-804b-eca2dfe0bf18", "date": "Sat, 21 Dec 2024 06:18:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
30842024-12-21T06:18:00.659ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
30852024-12-21T06:18:00.661ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ea939a83-834f-4bac-9ff7-7e844ec3c01f", "date": "Sat, 21 Dec 2024 06:18:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
30862024-12-21T06:18:00.661ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
30872024-12-21T06:18:00.662ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
30882024-12-21T06:18:00.662ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 312.571859ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
30892024-12-21T06:18:00.708ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30902024-12-21T06:18:00.708ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "aafa2fb6-efb0-4ad7-b31a-3f5c810a9747", "content-length": "691", "date": "Sat, 21 Dec 2024 06:18:00 GMT"} })
30912024-12-21T06:18:00.708ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
30922024-12-21T06:18:00.708ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
30932024-12-21T06:18:00.708ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
30942024-12-21T06:18:00.709ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 358.76311ms iteration = 9 status = {}
30952024-12-21T06:18:00.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30962024-12-21T06:18:00.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30972024-12-21T06:18:00.712ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30982024-12-21T06:18:00.713ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30992024-12-21T06:18:00.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31002024-12-21T06:18:00.713ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0019665e-df47-4fbb-8b5d-bd0802b5c6d1", "content-length": "1", "date": "Sat, 21 Dec 2024 06:17:59 GMT"} })
31012024-12-21T06:18:00.715ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31022024-12-21T06:18:00.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31032024-12-21T06:18:00.716ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
31042024-12-21T06:18:00.716ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31052024-12-21T06:18:00.716ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8e0bcf64-e17d-46dd-993e-dacd844f8d1f", "date": "Sat, 21 Dec 2024 06:18:00 GMT"} })
31062024-12-21T06:18:00.717ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 367.364609ms iteration = 9 status = null
31072024-12-21T06:18:00.717ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 361.734342ms iteration = 10 status = {}
31082024-12-21T06:18:00.724ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 374.409014ms iteration = 9 status = {}
31092024-12-21T06:18:00.746ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
31102024-12-21T06:18:00.746ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8ecec3a0-b12d-41f5-9990-994ad673bba8", "date": "Sat, 21 Dec 2024 06:18:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
31112024-12-21T06:18:00.746ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
31122024-12-21T06:18:00.747ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3baaa6c6-3dbb-4fe6-b5c6-a2e19441d050", "date": "Sat, 21 Dec 2024 06:18:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
31132024-12-21T06:18:00.747ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
31142024-12-21T06:18:00.749ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "81727193-744b-49da-85f9-605198b88644", "date": "Sat, 21 Dec 2024 06:18:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
31152024-12-21T06:18:00.749ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
31162024-12-21T06:18:00.751ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
31172024-12-21T06:18:00.751ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 401.531206ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
31182024-12-21T06:18:00.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31192024-12-21T06:18:00.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31202024-12-21T06:18:00.810ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
31212024-12-21T06:18:00.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31222024-12-21T06:18:00.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31232024-12-21T06:18:00.869ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
31242024-12-21T06:18:00.869ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "928e1bfa-63ff-41b1-995e-2c3f5e551cb0", "content-length": "134", "date": "Sat, 21 Dec 2024 06:17:59 GMT"} })
31252024-12-21T06:18:00.869ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
31262024-12-21T06:18:00.869ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
31272024-12-21T06:18:00.870ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
31282024-12-21T06:18:00.870ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31292024-12-21T06:18:00.870ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31302024-12-21T06:18:00.870ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31312024-12-21T06:18:00.870ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31322024-12-21T06:18:00.870ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31332024-12-21T06:18:00.870ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31342024-12-21T06:18:00.870ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31352024-12-21T06:18:00.870ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
31362024-12-21T06:18:00.870ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31372024-12-21T06:18:00.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31382024-12-21T06:18:00.872ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
31392024-12-21T06:18:00.873ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "61f6433f-21b0-4175-b55e-cdf116b01f47", "content-length": "2", "date": "Sat, 21 Dec 2024 06:17:59 GMT"} })
31402024-12-21T06:18:00.873ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
31412024-12-21T06:18:00.873ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8e2f25e-be2d-4aa8-9f68-ead57f663f41", "content-length": "52", "date": "Sat, 21 Dec 2024 06:17:59 GMT"} })
31422024-12-21T06:18:00.873ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
31432024-12-21T06:18:00.873ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
31442024-12-21T06:18:00.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 4bda04fd-f6b5-4d71-be80-7820bcefc9a6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
31452024-12-21T06:18:00.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 4bda04fd-f6b5-4d71-be80-7820bcefc9a6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
31462024-12-21T06:18:00.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 4bda04fd-f6b5-4d71-be80-7820bcefc9a6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
31472024-12-21T06:18:00.964ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "61a4cad8-5ffc-4d5e-9284-99d125a99f55", "date": "Sat, 21 Dec 2024 06:18:00 GMT"} })
31482024-12-21T06:18:00.964ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
31492024-12-21T06:18:00.964ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31502024-12-21T06:18:00.964ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "39458cbf-a61c-4508-b954-fcaf2996e73e", "content-length": "682", "date": "Sat, 21 Dec 2024 06:18:00 GMT"} })
31512024-12-21T06:18:00.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31522024-12-21T06:18:00.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31532024-12-21T06:18:00.969ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31542024-12-21T06:18:00.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31552024-12-21T06:18:00.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31562024-12-21T06:18:00.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31572024-12-21T06:18:00.975ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31582024-12-21T06:18:00.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31592024-12-21T06:18:00.982ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 631.749562ms iteration = 9 status = {}
31602024-12-21T06:18:01.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f4ce84d1-595e-41a5-b62c-fcd208201aad roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31612024-12-21T06:18:01.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f4ce84d1-595e-41a5-b62c-fcd208201aad resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31622024-12-21T06:18:01.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f4ce84d1-595e-41a5-b62c-fcd208201aad response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31632024-12-21T06:18:02.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7ff9f638-0fbe-4c33-8aa6-a1485012ee84 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31642024-12-21T06:18:02.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7ff9f638-0fbe-4c33-8aa6-a1485012ee84 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31652024-12-21T06:18:02.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7ff9f638-0fbe-4c33-8aa6-a1485012ee84 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31662024-12-21T06:18:03.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 004fbac1-241c-46f7-aab8-f5c448178820 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31672024-12-21T06:18:03.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 004fbac1-241c-46f7-aab8-f5c448178820 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31682024-12-21T06:18:03.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 004fbac1-241c-46f7-aab8-f5c448178820 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31692024-12-21T06:18:03.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1503 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = c098fd26-0432-43cb-8c3f-c131591d53a2 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
31702024-12-21T06:18:04.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 889d63c9-fbc5-472e-8c7a-95ca3688ddee roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31712024-12-21T06:18:04.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 889d63c9-fbc5-472e-8c7a-95ca3688ddee resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31722024-12-21T06:18:04.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 889d63c9-fbc5-472e-8c7a-95ca3688ddee response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31732024-12-21T06:18:05.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1d67f420-3783-4d74-a9fe-ecbc2108b0f7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31742024-12-21T06:18:05.702ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1d67f420-3783-4d74-a9fe-ecbc2108b0f7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31752024-12-21T06:18:05.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1d67f420-3783-4d74-a9fe-ecbc2108b0f7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31762024-12-21T06:18:06.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 60c8c288-0101-49cc-9ce4-6d4c2088a685 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31772024-12-21T06:18:06.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 60c8c288-0101-49cc-9ce4-6d4c2088a685 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31782024-12-21T06:18:06.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 60c8c288-0101-49cc-9ce4-6d4c2088a685 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31792024-12-21T06:18:07.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f9faee8b-70a1-4175-a64f-ad075e4fc59a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31802024-12-21T06:18:07.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f9faee8b-70a1-4175-a64f-ad075e4fc59a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31812024-12-21T06:18:07.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f9faee8b-70a1-4175-a64f-ad075e4fc59a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31822024-12-21T06:18:08.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 357eb856-5563-4aa5-bb68-7dd8441a98bd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31832024-12-21T06:18:08.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 357eb856-5563-4aa5-bb68-7dd8441a98bd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31842024-12-21T06:18:08.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 357eb856-5563-4aa5-bb68-7dd8441a98bd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31852024-12-21T06:18:09.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fe42146e-de89-40c7-b769-d5d7cbe582a4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31862024-12-21T06:18:09.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fe42146e-de89-40c7-b769-d5d7cbe582a4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31872024-12-21T06:18:09.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fe42146e-de89-40c7-b769-d5d7cbe582a4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
31882024-12-21T06:18:10.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
31892024-12-21T06:18:10.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31902024-12-21T06:18:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31912024-12-21T06:18:10.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
31922024-12-21T06:18:10.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31932024-12-21T06:18:10.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31942024-12-21T06:18:10.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31952024-12-21T06:18:10.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31962024-12-21T06:18:10.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31972024-12-21T06:18:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31982024-12-21T06:18:10.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31992024-12-21T06:18:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32002024-12-21T06:18:10.355ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.795275ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32012024-12-21T06:18:10.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32022024-12-21T06:18:10.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32032024-12-21T06:18:10.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32042024-12-21T06:18:10.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
32052024-12-21T06:18:10.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32062024-12-21T06:18:10.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32072024-12-21T06:18:10.371ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
32082024-12-21T06:18:10.371ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.56846ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
32092024-12-21T06:18:10.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e741f8b1-81b0-4778-90e5-7ae6e4b3d4d9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32102024-12-21T06:18:10.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e741f8b1-81b0-4778-90e5-7ae6e4b3d4d9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32112024-12-21T06:18:10.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e741f8b1-81b0-4778-90e5-7ae6e4b3d4d9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32122024-12-21T06:18:11.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ffb45a61-aa44-435c-ba50-0e209bb1d3aa roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32132024-12-21T06:18:11.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ffb45a61-aa44-435c-ba50-0e209bb1d3aa resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32142024-12-21T06:18:11.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ffb45a61-aa44-435c-ba50-0e209bb1d3aa response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32152024-12-21T06:18:12.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4f10daa8-5d45-487d-a1b3-2ce2e4cd7876 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32162024-12-21T06:18:12.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4f10daa8-5d45-487d-a1b3-2ce2e4cd7876 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32172024-12-21T06:18:12.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4f10daa8-5d45-487d-a1b3-2ce2e4cd7876 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32182024-12-21T06:18:13.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cd4f8805-0cd9-4b5b-9aad-667b7890958b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32192024-12-21T06:18:13.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cd4f8805-0cd9-4b5b-9aad-667b7890958b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32202024-12-21T06:18:13.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cd4f8805-0cd9-4b5b-9aad-667b7890958b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32212024-12-21T06:18:13.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1236 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = f0a78d83-bb5a-46ee-b055-3c27cec0022b response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
32222024-12-21T06:18:14.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7d08b264-3987-4023-8892-ef1a1d4782cf roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32232024-12-21T06:18:14.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7d08b264-3987-4023-8892-ef1a1d4782cf resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32242024-12-21T06:18:14.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7d08b264-3987-4023-8892-ef1a1d4782cf response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32252024-12-21T06:18:15.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dd9bfd8e-db9c-451c-beaa-d6bc2aaac5ec roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32262024-12-21T06:18:15.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dd9bfd8e-db9c-451c-beaa-d6bc2aaac5ec resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32272024-12-21T06:18:15.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dd9bfd8e-db9c-451c-beaa-d6bc2aaac5ec response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32282024-12-21T06:18:16.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 70792730-8a84-461d-8be2-b8f7de639eb0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32292024-12-21T06:18:16.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 70792730-8a84-461d-8be2-b8f7de639eb0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32302024-12-21T06:18:16.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 70792730-8a84-461d-8be2-b8f7de639eb0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32312024-12-21T06:18:17.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 885cd244-841b-4c2e-9695-87aed127cda3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32322024-12-21T06:18:17.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 885cd244-841b-4c2e-9695-87aed127cda3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32332024-12-21T06:18:17.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 885cd244-841b-4c2e-9695-87aed127cda3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32342024-12-21T06:18:18.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 763a0a57-3f49-4dbf-a7d3-c2cb6f91a990 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32352024-12-21T06:18:18.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 763a0a57-3f49-4dbf-a7d3-c2cb6f91a990 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32362024-12-21T06:18:18.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 763a0a57-3f49-4dbf-a7d3-c2cb6f91a990 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32372024-12-21T06:18:20.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ea82b375-7ecd-407a-b59d-daa5d185d0c5 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32382024-12-21T06:18:20.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ea82b375-7ecd-407a-b59d-daa5d185d0c5 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32392024-12-21T06:18:20.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ea82b375-7ecd-407a-b59d-daa5d185d0c5 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32402024-12-21T06:18:20.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
32412024-12-21T06:18:20.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32422024-12-21T06:18:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32432024-12-21T06:18:20.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
32442024-12-21T06:18:20.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32452024-12-21T06:18:20.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32462024-12-21T06:18:20.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32472024-12-21T06:18:20.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32482024-12-21T06:18:20.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32492024-12-21T06:18:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32502024-12-21T06:18:20.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32512024-12-21T06:18:20.354ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.711532ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32522024-12-21T06:18:20.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32532024-12-21T06:18:20.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32542024-12-21T06:18:20.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32552024-12-21T06:18:20.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32562024-12-21T06:18:20.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
32572024-12-21T06:18:20.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32582024-12-21T06:18:20.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32592024-12-21T06:18:20.372ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
32602024-12-21T06:18:20.372ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.842604ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
32612024-12-21T06:18:21.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d70ce341-6488-4fb9-b24b-8cd5807eeef8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32622024-12-21T06:18:21.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d70ce341-6488-4fb9-b24b-8cd5807eeef8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32632024-12-21T06:18:21.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d70ce341-6488-4fb9-b24b-8cd5807eeef8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32642024-12-21T06:18:22.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fc278590-58f4-4274-93b3-9a23b307a8fb roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32652024-12-21T06:18:22.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fc278590-58f4-4274-93b3-9a23b307a8fb resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32662024-12-21T06:18:22.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fc278590-58f4-4274-93b3-9a23b307a8fb response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32672024-12-21T06:18:23.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 19e42cfc-0117-4d85-a345-e891c14763e3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32682024-12-21T06:18:23.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 19e42cfc-0117-4d85-a345-e891c14763e3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32692024-12-21T06:18:23.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 19e42cfc-0117-4d85-a345-e891c14763e3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32702024-12-21T06:18:23.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1344 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 71d94d07-bc77-421f-b21b-ae5ddf20b344 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
32712024-12-21T06:18:24.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78162353-c968-4abf-aff3-7d9ab89061cd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32722024-12-21T06:18:24.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78162353-c968-4abf-aff3-7d9ab89061cd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32732024-12-21T06:18:24.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78162353-c968-4abf-aff3-7d9ab89061cd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32742024-12-21T06:18:25.114ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf08f71b-c4b5-4b2f-9176-ca4b29a53a0b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32752024-12-21T06:18:25.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf08f71b-c4b5-4b2f-9176-ca4b29a53a0b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32762024-12-21T06:18:25.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf08f71b-c4b5-4b2f-9176-ca4b29a53a0b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32772024-12-21T06:18:26.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 86f03049-bf32-4d65-944c-647a0e4416bc roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32782024-12-21T06:18:26.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 86f03049-bf32-4d65-944c-647a0e4416bc resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32792024-12-21T06:18:26.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 86f03049-bf32-4d65-944c-647a0e4416bc response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32802024-12-21T06:18:27.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ab46d4a-4adc-49e4-b200-72fada88cda1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32812024-12-21T06:18:27.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ab46d4a-4adc-49e4-b200-72fada88cda1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32822024-12-21T06:18:27.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ab46d4a-4adc-49e4-b200-72fada88cda1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32832024-12-21T06:18:28.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 89fa84f9-a044-4ff8-b3e0-9f68d8afc544 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32842024-12-21T06:18:28.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 89fa84f9-a044-4ff8-b3e0-9f68d8afc544 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32852024-12-21T06:18:28.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 89fa84f9-a044-4ff8-b3e0-9f68d8afc544 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32862024-12-21T06:18:28.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33656 req_id = d5f0ea23-a4f1-46a3-87cf-bdb5a9e24476 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
32872024-12-21T06:18:28.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33656 req_id = d5f0ea23-a4f1-46a3-87cf-bdb5a9e24476 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
32882024-12-21T06:18:28.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3072 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33656 req_id = d5f0ea23-a4f1-46a3-87cf-bdb5a9e24476 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
32892024-12-21T06:18:28.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33656 req_id = b417889e-3273-4d7c-a378-84475142dbca roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
32902024-12-21T06:18:28.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33656 req_id = b417889e-3273-4d7c-a378-84475142dbca resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
32912024-12-21T06:18:28.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2658 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33656 req_id = b417889e-3273-4d7c-a378-84475142dbca response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
32922024-12-21T06:18:29.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bfdc339a-b0a6-4bdb-b326-a196358b9a53 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32932024-12-21T06:18:29.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bfdc339a-b0a6-4bdb-b326-a196358b9a53 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32942024-12-21T06:18:29.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bfdc339a-b0a6-4bdb-b326-a196358b9a53 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32952024-12-21T06:18:30.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 371fbc8b-c831-4290-bddf-8063e6342e9c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32962024-12-21T06:18:30.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 371fbc8b-c831-4290-bddf-8063e6342e9c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32972024-12-21T06:18:30.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 371fbc8b-c831-4290-bddf-8063e6342e9c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
32982024-12-21T06:18:30.351ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
32992024-12-21T06:18:30.351ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
33002024-12-21T06:18:30.351ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33012024-12-21T06:18:30.351ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
33022024-12-21T06:18:30.351ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33032024-12-21T06:18:30.351ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
33042024-12-21T06:18:30.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33052024-12-21T06:18:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33062024-12-21T06:18:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33072024-12-21T06:18:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33082024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
33092024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
33102024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33112024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33122024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
33132024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33142024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
33152024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33162024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33172024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
33182024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33192024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
33202024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33212024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
33222024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33232024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
33242024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33252024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33262024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33272024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33282024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33292024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33302024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33312024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33322024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33332024-12-21T06:18:30.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33342024-12-21T06:18:30.353ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.942382ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33352024-12-21T06:18:30.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1241, tv_nsec: 438757235 } })
33362024-12-21T06:18:30.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1241, tv_nsec: 438779816 } })
33372024-12-21T06:18:30.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
33382024-12-21T06:18:30.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
33392024-12-21T06:18:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33402024-12-21T06:18:30.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33412024-12-21T06:18:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33422024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
33432024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33442024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
33452024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33462024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
33472024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
33482024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33492024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33502024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
33512024-12-21T06:18:30.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
33522024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33532024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33542024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33552024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33562024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33572024-12-21T06:18:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33582024-12-21T06:18:30.357ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33592024-12-21T06:18:30.357ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33602024-12-21T06:18:30.358ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33612024-12-21T06:18:30.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33622024-12-21T06:18:30.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33632024-12-21T06:18:30.359ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33642024-12-21T06:18:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33652024-12-21T06:18:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
33662024-12-21T06:18:30.360ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33672024-12-21T06:18:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33682024-12-21T06:18:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33692024-12-21T06:18:30.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33702024-12-21T06:18:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33712024-12-21T06:18:30.361ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33722024-12-21T06:18:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33732024-12-21T06:18:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
33742024-12-21T06:18:30.361ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33752024-12-21T06:18:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33762024-12-21T06:18:30.362ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33772024-12-21T06:18:30.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33782024-12-21T06:18:30.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33792024-12-21T06:18:30.366ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33802024-12-21T06:18:30.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33812024-12-21T06:18:30.366ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33822024-12-21T06:18:30.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33832024-12-21T06:18:30.367ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.922624ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33842024-12-21T06:18:30.367ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1241, tv_nsec: 451615522 } })
33852024-12-21T06:18:30.367ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33862024-12-21T06:18:30.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33872024-12-21T06:18:30.367ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
33882024-12-21T06:18:30.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33892024-12-21T06:18:30.368ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33902024-12-21T06:18:30.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33912024-12-21T06:18:30.369ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33922024-12-21T06:18:30.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33932024-12-21T06:18:30.369ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33942024-12-21T06:18:30.370ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 13.992268ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33952024-12-21T06:18:30.371ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33962024-12-21T06:18:30.371ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.278044ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33972024-12-21T06:18:30.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33982024-12-21T06:18:30.371ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33992024-12-21T06:18:30.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34002024-12-21T06:18:30.383ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34012024-12-21T06:18:30.383ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34022024-12-21T06:18:30.383ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34032024-12-21T06:18:30.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34042024-12-21T06:18:30.386ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34052024-12-21T06:18:30.386ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
34062024-12-21T06:18:30.386ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34072024-12-21T06:18:30.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34082024-12-21T06:18:30.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 35.586317ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
34092024-12-21T06:18:30.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34102024-12-21T06:18:30.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34112024-12-21T06:18:30.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34122024-12-21T06:18:30.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34132024-12-21T06:18:30.396ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34142024-12-21T06:18:30.397ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34152024-12-21T06:18:30.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34162024-12-21T06:18:30.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
34172024-12-21T06:18:30.398ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34182024-12-21T06:18:30.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34192024-12-21T06:18:30.399ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 47.883058ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
34202024-12-21T06:18:30.400ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.948439ms iteration = 10 status = 0
34212024-12-21T06:18:30.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34222024-12-21T06:18:30.402ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34232024-12-21T06:18:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34242024-12-21T06:18:30.402ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.445468ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
34252024-12-21T06:18:30.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34262024-12-21T06:18:30.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34272024-12-21T06:18:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34282024-12-21T06:18:30.404ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34292024-12-21T06:18:30.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34302024-12-21T06:18:30.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34312024-12-21T06:18:30.406ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 50.019587ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
34322024-12-21T06:18:30.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
34332024-12-21T06:18:30.408ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34342024-12-21T06:18:30.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34352024-12-21T06:18:30.420ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34362024-12-21T06:18:30.420ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34372024-12-21T06:18:30.420ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 68.141521ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
34382024-12-21T06:18:30.424ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
34392024-12-21T06:18:30.424ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.510729ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
34402024-12-21T06:18:30.425ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34412024-12-21T06:18:30.425ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34422024-12-21T06:18:30.425ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7384add-c79a-48c7-8e35-a4aa7b97a3cb", "content-length": "26", "date": "Sat, 21 Dec 2024 06:18:30 GMT"} })
34432024-12-21T06:18:30.425ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34442024-12-21T06:18:30.427ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34452024-12-21T06:18:30.428ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34462024-12-21T06:18:30.428ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34472024-12-21T06:18:30.428ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd4ccd72-061c-4ee7-a9fa-f486db0ffcb8", "content-length": "26", "date": "Sat, 21 Dec 2024 06:18:30 GMT"} })
34482024-12-21T06:18:30.428ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34492024-12-21T06:18:30.430ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34502024-12-21T06:18:30.446ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
34512024-12-21T06:18:30.446ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34522024-12-21T06:18:30.446ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "04d5cc5d-94ce-47a7-a99e-ca6d9071349e", "content-length": "26", "date": "Sat, 21 Dec 2024 06:18:30 GMT"} })
34532024-12-21T06:18:30.446ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34542024-12-21T06:18:30.448ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
34552024-12-21T06:18:30.467ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34562024-12-21T06:18:30.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34572024-12-21T06:18:30.469ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34582024-12-21T06:18:30.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34592024-12-21T06:18:30.471ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34602024-12-21T06:18:30.471ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 119.227407ms iteration = 13 status = {"physical_disks_added":0}
34612024-12-21T06:18:30.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34622024-12-21T06:18:30.518ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 167.3184ms iteration = 10 status = {}
34632024-12-21T06:18:30.524ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34642024-12-21T06:18:30.524ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "780fd293-ac21-4caa-85eb-01cd6e90e9a4", "content-length": "1", "date": "Sat, 21 Dec 2024 06:18:30 GMT"} })
34652024-12-21T06:18:30.525ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34662024-12-21T06:18:30.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34672024-12-21T06:18:30.543ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34682024-12-21T06:18:30.543ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34692024-12-21T06:18:30.543ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7140442-99b3-4894-bd3e-c4a04ad4da98", "content-length": "372", "date": "Sat, 21 Dec 2024 06:18:30 GMT"} })
34702024-12-21T06:18:30.543ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34712024-12-21T06:18:30.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34722024-12-21T06:18:30.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34732024-12-21T06:18:30.545ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 194.437123ms iteration = 10 status = null
34742024-12-21T06:18:30.546ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34752024-12-21T06:18:30.546ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34762024-12-21T06:18:30.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34772024-12-21T06:18:30.557ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
34782024-12-21T06:18:30.557ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34792024-12-21T06:18:30.557ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a0683030-5851-43ed-95ef-202548dda940", "date": "Sat, 21 Dec 2024 06:18:30 GMT"} })
34802024-12-21T06:18:30.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34812024-12-21T06:18:30.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34822024-12-21T06:18:30.559ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34832024-12-21T06:18:30.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34842024-12-21T06:18:30.562ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34852024-12-21T06:18:30.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34862024-12-21T06:18:30.565ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
34872024-12-21T06:18:30.565ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34882024-12-21T06:18:30.566ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "30b7720b-49cb-48fa-aff6-7f2b63707b03", "date": "Sat, 21 Dec 2024 06:18:30 GMT"} })
34892024-12-21T06:18:30.568ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 211.988289ms iteration = 11 status = {}
34902024-12-21T06:18:30.610ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34912024-12-21T06:18:30.610ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8d24914-b3fb-4316-9072-5ac1c760e2a5", "content-length": "691", "date": "Sat, 21 Dec 2024 06:18:30 GMT"} })
34922024-12-21T06:18:30.610ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
34932024-12-21T06:18:30.610ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
34942024-12-21T06:18:30.610ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
34952024-12-21T06:18:30.611ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 259.576079ms iteration = 10 status = {}
34962024-12-21T06:18:30.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34972024-12-21T06:18:30.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34982024-12-21T06:18:30.628ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
34992024-12-21T06:18:30.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35002024-12-21T06:18:30.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35012024-12-21T06:18:30.635ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35022024-12-21T06:18:30.635ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "35a9d342-1276-4a94-b7f5-eaf8ae2a9fc4", "content-length": "134", "date": "Sat, 21 Dec 2024 06:18:30 GMT"} })
35032024-12-21T06:18:30.635ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35042024-12-21T06:18:30.635ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
35052024-12-21T06:18:30.635ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35062024-12-21T06:18:30.635ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35072024-12-21T06:18:30.635ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35082024-12-21T06:18:30.635ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35092024-12-21T06:18:30.635ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35102024-12-21T06:18:30.635ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35112024-12-21T06:18:30.636ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35122024-12-21T06:18:30.636ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35132024-12-21T06:18:30.636ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
35142024-12-21T06:18:30.636ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35152024-12-21T06:18:30.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35162024-12-21T06:18:30.637ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35172024-12-21T06:18:30.638ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3e1138a-b888-4b66-9ada-9a21f400091e", "content-length": "2", "date": "Sat, 21 Dec 2024 06:18:30 GMT"} })
35182024-12-21T06:18:30.638ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35192024-12-21T06:18:30.638ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1857607-ffd2-4be1-a2ae-254ddd448757", "content-length": "52", "date": "Sat, 21 Dec 2024 06:18:30 GMT"} })
35202024-12-21T06:18:30.638ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
35212024-12-21T06:18:30.638ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35222024-12-21T06:18:30.731ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "42efc9fb-608f-4f33-bb45-e6aabd406fef", "date": "Sat, 21 Dec 2024 06:18:30 GMT"} })
35232024-12-21T06:18:30.731ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
35242024-12-21T06:18:30.731ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35252024-12-21T06:18:30.731ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4814bcb-91f5-4e19-aef7-6b1b00a02ecd", "content-length": "682", "date": "Sat, 21 Dec 2024 06:18:30 GMT"} })
35262024-12-21T06:18:30.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35272024-12-21T06:18:30.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35282024-12-21T06:18:30.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35292024-12-21T06:18:30.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35302024-12-21T06:18:30.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35312024-12-21T06:18:30.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35322024-12-21T06:18:30.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35332024-12-21T06:18:30.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35342024-12-21T06:18:30.748ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 396.827766ms iteration = 10 status = {}
35352024-12-21T06:18:30.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 05fbd937-869a-4f0e-b384-4ce128c4acfe roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
35362024-12-21T06:18:30.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 05fbd937-869a-4f0e-b384-4ce128c4acfe resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
35372024-12-21T06:18:30.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 05fbd937-869a-4f0e-b384-4ce128c4acfe response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
35382024-12-21T06:18:31.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0c591767-5fee-416a-940a-99c0ad2d087c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35392024-12-21T06:18:31.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0c591767-5fee-416a-940a-99c0ad2d087c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35402024-12-21T06:18:31.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2534 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0c591767-5fee-416a-940a-99c0ad2d087c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35412024-12-21T06:18:32.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 90509083-558c-4dac-aee0-d80160d02629 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35422024-12-21T06:18:32.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 90509083-558c-4dac-aee0-d80160d02629 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35432024-12-21T06:18:32.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1589 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 90509083-558c-4dac-aee0-d80160d02629 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35442024-12-21T06:18:33.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 44b5f5f4-7318-4f0b-96c4-3a7023a7f225 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35452024-12-21T06:18:33.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 44b5f5f4-7318-4f0b-96c4-3a7023a7f225 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35462024-12-21T06:18:33.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2126 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 44b5f5f4-7318-4f0b-96c4-3a7023a7f225 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35472024-12-21T06:18:33.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1209 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 70f68a93-325f-426e-a43c-f2799971e7ce response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
35482024-12-21T06:18:34.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95cad75d-f1a2-4a29-baf2-d05bfeb0e6e2 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35492024-12-21T06:18:34.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95cad75d-f1a2-4a29-baf2-d05bfeb0e6e2 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35502024-12-21T06:18:34.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95cad75d-f1a2-4a29-baf2-d05bfeb0e6e2 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35512024-12-21T06:18:35.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 99ee4070-1baa-4045-be0e-b701897dff1d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35522024-12-21T06:18:35.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 99ee4070-1baa-4045-be0e-b701897dff1d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35532024-12-21T06:18:35.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 99ee4070-1baa-4045-be0e-b701897dff1d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35542024-12-21T06:18:36.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7918b8ba-3ac4-4c1e-8cde-7c0080f701d1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35552024-12-21T06:18:36.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7918b8ba-3ac4-4c1e-8cde-7c0080f701d1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35562024-12-21T06:18:36.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7918b8ba-3ac4-4c1e-8cde-7c0080f701d1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35572024-12-21T06:18:37.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3384a575-d15d-40e0-ad2c-2cbd8b396666 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35582024-12-21T06:18:37.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3384a575-d15d-40e0-ad2c-2cbd8b396666 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35592024-12-21T06:18:37.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3384a575-d15d-40e0-ad2c-2cbd8b396666 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35602024-12-21T06:18:38.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 47735714-5a59-4846-b63f-156369312ce7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35612024-12-21T06:18:38.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 47735714-5a59-4846-b63f-156369312ce7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35622024-12-21T06:18:38.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 47735714-5a59-4846-b63f-156369312ce7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35632024-12-21T06:18:39.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1feb208f-001f-4efb-ad58-978bf90e15b5 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35642024-12-21T06:18:39.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1feb208f-001f-4efb-ad58-978bf90e15b5 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35652024-12-21T06:18:39.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1feb208f-001f-4efb-ad58-978bf90e15b5 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35662024-12-21T06:18:40.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
35672024-12-21T06:18:40.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35682024-12-21T06:18:40.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35692024-12-21T06:18:40.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
35702024-12-21T06:18:40.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35712024-12-21T06:18:40.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35722024-12-21T06:18:40.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35732024-12-21T06:18:40.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35742024-12-21T06:18:40.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35752024-12-21T06:18:40.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35762024-12-21T06:18:40.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35772024-12-21T06:18:40.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35782024-12-21T06:18:40.355ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.900948ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35792024-12-21T06:18:40.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35802024-12-21T06:18:40.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35812024-12-21T06:18:40.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35822024-12-21T06:18:40.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
35832024-12-21T06:18:40.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35842024-12-21T06:18:40.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35852024-12-21T06:18:40.371ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
35862024-12-21T06:18:40.371ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.387684ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
35872024-12-21T06:18:40.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a50684b1-8d74-4df7-9e92-0caec65cb29c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35882024-12-21T06:18:40.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a50684b1-8d74-4df7-9e92-0caec65cb29c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35892024-12-21T06:18:40.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a50684b1-8d74-4df7-9e92-0caec65cb29c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35902024-12-21T06:18:41.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 09d64713-e1df-4f8c-965e-23ab0001e971 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35912024-12-21T06:18:41.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 09d64713-e1df-4f8c-965e-23ab0001e971 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35922024-12-21T06:18:41.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 09d64713-e1df-4f8c-965e-23ab0001e971 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35932024-12-21T06:18:42.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd011f09-500a-4fe5-9145-a0c91f02952b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35942024-12-21T06:18:42.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd011f09-500a-4fe5-9145-a0c91f02952b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35952024-12-21T06:18:42.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd011f09-500a-4fe5-9145-a0c91f02952b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35962024-12-21T06:18:43.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 51c57d80-7269-4e1a-abb2-a38bb4721e3e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35972024-12-21T06:18:43.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 51c57d80-7269-4e1a-abb2-a38bb4721e3e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35982024-12-21T06:18:43.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 51c57d80-7269-4e1a-abb2-a38bb4721e3e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
35992024-12-21T06:18:43.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1287 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = ac1f6e1a-95e3-4359-ae1e-e4a213b5b1a1 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
36002024-12-21T06:18:44.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4aae895a-7be0-4095-b09f-58924ba66904 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36012024-12-21T06:18:44.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4aae895a-7be0-4095-b09f-58924ba66904 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36022024-12-21T06:18:44.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4aae895a-7be0-4095-b09f-58924ba66904 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36032024-12-21T06:18:45.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 901b0048-047c-49eb-bbbd-51392bbfb526 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36042024-12-21T06:18:45.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 901b0048-047c-49eb-bbbd-51392bbfb526 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36052024-12-21T06:18:45.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 901b0048-047c-49eb-bbbd-51392bbfb526 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36062024-12-21T06:18:46.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dba1c6ca-c0d6-44c9-828f-c9089266a127 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36072024-12-21T06:18:46.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dba1c6ca-c0d6-44c9-828f-c9089266a127 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36082024-12-21T06:18:46.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1620 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dba1c6ca-c0d6-44c9-828f-c9089266a127 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36092024-12-21T06:18:47.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d06cde33-5b8b-4dbe-a5db-d7ec9063bea4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36102024-12-21T06:18:47.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d06cde33-5b8b-4dbe-a5db-d7ec9063bea4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36112024-12-21T06:18:47.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d06cde33-5b8b-4dbe-a5db-d7ec9063bea4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36122024-12-21T06:18:48.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 705ac0f9-afe1-4c6e-84d1-f6dd8724c481 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36132024-12-21T06:18:48.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 705ac0f9-afe1-4c6e-84d1-f6dd8724c481 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36142024-12-21T06:18:48.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 705ac0f9-afe1-4c6e-84d1-f6dd8724c481 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36152024-12-21T06:18:49.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 81bfd703-b00c-4259-b3fe-2c62931f1094 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36162024-12-21T06:18:49.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 81bfd703-b00c-4259-b3fe-2c62931f1094 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36172024-12-21T06:18:49.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 81bfd703-b00c-4259-b3fe-2c62931f1094 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36182024-12-21T06:18:50.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
36192024-12-21T06:18:50.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36202024-12-21T06:18:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36212024-12-21T06:18:50.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
36222024-12-21T06:18:50.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36232024-12-21T06:18:50.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36242024-12-21T06:18:50.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36252024-12-21T06:18:50.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36262024-12-21T06:18:50.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36272024-12-21T06:18:50.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36282024-12-21T06:18:50.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36292024-12-21T06:18:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36302024-12-21T06:18:50.355ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.858267ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36312024-12-21T06:18:50.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36322024-12-21T06:18:50.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36332024-12-21T06:18:50.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36342024-12-21T06:18:50.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
36352024-12-21T06:18:50.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36362024-12-21T06:18:50.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36372024-12-21T06:18:50.369ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
36382024-12-21T06:18:50.369ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.865393ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
36392024-12-21T06:18:50.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8256e3bd-4178-491b-bc32-04e1505f7515 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36402024-12-21T06:18:50.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8256e3bd-4178-491b-bc32-04e1505f7515 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36412024-12-21T06:18:50.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8256e3bd-4178-491b-bc32-04e1505f7515 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36422024-12-21T06:18:51.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26a01591-f3ae-4b75-a3b2-20a650b8eb46 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36432024-12-21T06:18:51.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26a01591-f3ae-4b75-a3b2-20a650b8eb46 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36442024-12-21T06:18:51.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26a01591-f3ae-4b75-a3b2-20a650b8eb46 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36452024-12-21T06:18:52.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a8dc9f49-516f-486a-af62-280cbef84f43 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36462024-12-21T06:18:52.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a8dc9f49-516f-486a-af62-280cbef84f43 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36472024-12-21T06:18:52.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a8dc9f49-516f-486a-af62-280cbef84f43 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36482024-12-21T06:18:53.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2358a808-6800-4053-ba13-5faadd427351 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36492024-12-21T06:18:53.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2358a808-6800-4053-ba13-5faadd427351 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36502024-12-21T06:18:53.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2358a808-6800-4053-ba13-5faadd427351 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36512024-12-21T06:18:53.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1179 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = fea7341e-b5c6-4189-a7f9-f371bb56e1ae response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
36522024-12-21T06:18:54.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 92781d14-1c49-4a24-a5be-9ba518e3c5ea roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36532024-12-21T06:18:54.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 92781d14-1c49-4a24-a5be-9ba518e3c5ea resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36542024-12-21T06:18:54.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 92781d14-1c49-4a24-a5be-9ba518e3c5ea response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36552024-12-21T06:18:55.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7006803-d7ea-4841-8351-ea5bb03b60a6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36562024-12-21T06:18:55.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7006803-d7ea-4841-8351-ea5bb03b60a6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36572024-12-21T06:18:55.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7006803-d7ea-4841-8351-ea5bb03b60a6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36582024-12-21T06:18:56.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0795452e-7ea7-4067-a584-fd25c0eff3e8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36592024-12-21T06:18:56.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0795452e-7ea7-4067-a584-fd25c0eff3e8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36602024-12-21T06:18:56.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0795452e-7ea7-4067-a584-fd25c0eff3e8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36612024-12-21T06:18:57.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9bc5ca84-9847-44e6-a00d-df7f2abc641a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36622024-12-21T06:18:57.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9bc5ca84-9847-44e6-a00d-df7f2abc641a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36632024-12-21T06:18:57.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9bc5ca84-9847-44e6-a00d-df7f2abc641a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36642024-12-21T06:18:58.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5eba261c-135f-41ca-b049-3454b374bfce roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36652024-12-21T06:18:58.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5eba261c-135f-41ca-b049-3454b374bfce resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36662024-12-21T06:18:58.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5eba261c-135f-41ca-b049-3454b374bfce response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36672024-12-21T06:18:59.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 740e4536-0aaa-4786-878e-8745ad7eadd6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36682024-12-21T06:18:59.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 740e4536-0aaa-4786-878e-8745ad7eadd6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36692024-12-21T06:18:59.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 740e4536-0aaa-4786-878e-8745ad7eadd6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
36702024-12-21T06:19:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
36712024-12-21T06:19:00.350ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
36722024-12-21T06:19:00.350ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
36732024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36742024-12-21T06:19:00.351ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 06:09:00.350901484 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
36752024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
36762024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
36772024-12-21T06:19:00.351ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 7c419228-2431-4394-af83-ea0457364b70
36782024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.56\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"7c419228-2431-4394-af83-ea0457364b70"}
36792024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
36802024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
36812024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36822024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
36832024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
36842024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36852024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
36862024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
36872024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
36882024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
36892024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
36902024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
36912024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
36922024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
36932024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
36942024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
36952024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
36962024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36972024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
36982024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36992024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
37002024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
37012024-12-21T06:19:00.351ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
37022024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
37032024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
37042024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37052024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
37062024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
37072024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
37082024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37092024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37102024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
37112024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
37122024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37132024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37142024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
37152024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37162024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37172024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37182024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
37192024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37202024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37212024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37222024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37232024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37242024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
37252024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37262024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37272024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37282024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37292024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
37302024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37312024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37322024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37332024-12-21T06:19:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37342024-12-21T06:19:00.351ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("068965c6-3480-4953-b57e-dd969abb2a21.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("45c0a855-5592-491c-b7b3-470902319db2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1271, tv_nsec: 436180394 } })
37352024-12-21T06:19:00.351ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1271, tv_nsec: 436171434 } })
37362024-12-21T06:19:00.352ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
37372024-12-21T06:19:00.352ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.198383ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
37382024-12-21T06:19:00.352ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
37392024-12-21T06:19:00.352ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.329327ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
37402024-12-21T06:19:00.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1271, tv_nsec: 438218040 } })
37412024-12-21T06:19:00.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37422024-12-21T06:19:00.353ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 06:09:00.350901484 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
37432024-12-21T06:19:00.353ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.987273ms iteration = 6 status = {"expiration":"2024-12-21T06:09:00.350901484Z","pruned":[]}
37442024-12-21T06:19:00.354ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.076816ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37452024-12-21T06:19:00.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
37462024-12-21T06:19:00.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37472024-12-21T06:19:00.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37482024-12-21T06:19:00.354ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37492024-12-21T06:19:00.354ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37502024-12-21T06:19:00.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37512024-12-21T06:19:00.355ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
37522024-12-21T06:19:00.355ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
37532024-12-21T06:19:00.355ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
37542024-12-21T06:19:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
37552024-12-21T06:19:00.355ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1271, tv_nsec: 440287458 } })
37562024-12-21T06:19:00.356ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
37572024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
37582024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37592024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37602024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
37612024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
37622024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
37632024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
37642024-12-21T06:19:00.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
37652024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37662024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37672024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
37682024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
37692024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
37702024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37712024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
37722024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37732024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
37742024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
37752024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
37762024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37772024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
37782024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
37792024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37802024-12-21T06:19:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37812024-12-21T06:19:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37822024-12-21T06:19:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37832024-12-21T06:19:00.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37842024-12-21T06:19:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37852024-12-21T06:19:00.358ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37862024-12-21T06:19:00.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37872024-12-21T06:19:00.359ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37882024-12-21T06:19:00.360ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37892024-12-21T06:19:00.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
37902024-12-21T06:19:00.361ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
37912024-12-21T06:19:00.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
37922024-12-21T06:19:00.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37932024-12-21T06:19:00.362ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37942024-12-21T06:19:00.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37952024-12-21T06:19:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37962024-12-21T06:19:00.363ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37972024-12-21T06:19:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37982024-12-21T06:19:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37992024-12-21T06:19:00.363ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38002024-12-21T06:19:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38012024-12-21T06:19:00.365ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38022024-12-21T06:19:00.366ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38032024-12-21T06:19:00.366ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38042024-12-21T06:19:00.367ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38052024-12-21T06:19:00.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38062024-12-21T06:19:00.368ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38072024-12-21T06:19:00.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38082024-12-21T06:19:00.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
38092024-12-21T06:19:00.368ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38102024-12-21T06:19:00.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38112024-12-21T06:19:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
38122024-12-21T06:19:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38132024-12-21T06:19:00.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38142024-12-21T06:19:00.372ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.894251ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
38152024-12-21T06:19:00.372ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
38162024-12-21T06:19:00.372ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
38172024-12-21T06:19:00.372ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.398695ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
38182024-12-21T06:19:00.373ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
38192024-12-21T06:19:00.373ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
38202024-12-21T06:19:00.373ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
38212024-12-21T06:19:00.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38222024-12-21T06:19:00.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38232024-12-21T06:19:00.373ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38242024-12-21T06:19:00.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38252024-12-21T06:19:00.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38262024-12-21T06:19:00.376ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38272024-12-21T06:19:00.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38282024-12-21T06:19:00.377ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1271, tv_nsec: 462267498 } })
38292024-12-21T06:19:00.378ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38302024-12-21T06:19:00.378ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
38312024-12-21T06:19:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38322024-12-21T06:19:00.382ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38332024-12-21T06:19:00.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38342024-12-21T06:19:00.383ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38352024-12-21T06:19:00.384ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38362024-12-21T06:19:00.384ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38372024-12-21T06:19:00.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38382024-12-21T06:19:00.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38392024-12-21T06:19:00.385ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38402024-12-21T06:19:00.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
38412024-12-21T06:19:00.386ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38422024-12-21T06:19:00.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38432024-12-21T06:19:00.387ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38442024-12-21T06:19:00.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38452024-12-21T06:19:00.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38462024-12-21T06:19:00.387ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38472024-12-21T06:19:00.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38482024-12-21T06:19:00.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
38492024-12-21T06:19:00.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38502024-12-21T06:19:00.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38512024-12-21T06:19:00.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38522024-12-21T06:19:00.389ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38532024-12-21T06:19:00.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38542024-12-21T06:19:00.392ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38552024-12-21T06:19:00.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38562024-12-21T06:19:00.392ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
38572024-12-21T06:19:00.392ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
38582024-12-21T06:19:00.392ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38592024-12-21T06:19:00.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38602024-12-21T06:19:00.397ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38612024-12-21T06:19:00.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38622024-12-21T06:19:00.401ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38632024-12-21T06:19:00.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38642024-12-21T06:19:00.405ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38652024-12-21T06:19:00.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38662024-12-21T06:19:00.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38672024-12-21T06:19:00.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38682024-12-21T06:19:00.410ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
38692024-12-21T06:19:00.410ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
38702024-12-21T06:19:00.410ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 06:14:07.931887 UTC dns_group = internal generation = 1
38712024-12-21T06:19:00.410ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 59.827939ms iteration = 7 status = {"generation":1}
38722024-12-21T06:19:00.412ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38732024-12-21T06:19:00.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38742024-12-21T06:19:00.412ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38752024-12-21T06:19:00.415ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38762024-12-21T06:19:00.415ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
38772024-12-21T06:19:00.415ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38782024-12-21T06:19:00.416ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.628323ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
38792024-12-21T06:19:00.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38802024-12-21T06:19:00.416ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
38812024-12-21T06:19:00.416ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38822024-12-21T06:19:00.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38832024-12-21T06:19:00.417ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38842024-12-21T06:19:00.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38852024-12-21T06:19:00.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.402869ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38862024-12-21T06:19:00.419ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 62.511044ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
38872024-12-21T06:19:00.419ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38882024-12-21T06:19:00.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38892024-12-21T06:19:00.420ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.333853ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38902024-12-21T06:19:00.420ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
38912024-12-21T06:19:00.421ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 70.067923ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
38922024-12-21T06:19:00.421ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
38932024-12-21T06:19:00.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
38942024-12-21T06:19:00.422ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38952024-12-21T06:19:00.426ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
38962024-12-21T06:19:00.426ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
38972024-12-21T06:19:00.426ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
38982024-12-21T06:19:00.426ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38992024-12-21T06:19:00.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39002024-12-21T06:19:00.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
39012024-12-21T06:19:00.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39022024-12-21T06:19:00.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39032024-12-21T06:19:00.428ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39042024-12-21T06:19:00.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39052024-12-21T06:19:00.428ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 72.167171ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39062024-12-21T06:19:00.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39072024-12-21T06:19:00.430ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39082024-12-21T06:19:00.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39092024-12-21T06:19:00.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39102024-12-21T06:19:00.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39112024-12-21T06:19:00.431ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
39122024-12-21T06:19:00.431ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
39132024-12-21T06:19:00.431ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 80.259746ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
39142024-12-21T06:19:00.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39152024-12-21T06:19:00.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39162024-12-21T06:19:00.431ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39172024-12-21T06:19:00.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39182024-12-21T06:19:00.433ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39192024-12-21T06:19:00.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39202024-12-21T06:19:00.433ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39212024-12-21T06:19:00.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39222024-12-21T06:19:00.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39232024-12-21T06:19:00.434ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39242024-12-21T06:19:00.434ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.330551ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39252024-12-21T06:19:00.434ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39262024-12-21T06:19:00.437ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39272024-12-21T06:19:00.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39282024-12-21T06:19:00.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
39292024-12-21T06:19:00.439ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39302024-12-21T06:19:00.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39312024-12-21T06:19:00.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 84.435332ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
39322024-12-21T06:19:00.441ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39332024-12-21T06:19:00.442ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.837589ms iteration = 11 status = 0
39342024-12-21T06:19:00.443ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39352024-12-21T06:19:00.443ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39362024-12-21T06:19:00.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39372024-12-21T06:19:00.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39382024-12-21T06:19:00.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39392024-12-21T06:19:00.449ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39402024-12-21T06:19:00.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39412024-12-21T06:19:00.451ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 100.166458ms iteration = 14 status = {"physical_disks_added":0}
39422024-12-21T06:19:00.452ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39432024-12-21T06:19:00.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39442024-12-21T06:19:00.452ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
39452024-12-21T06:19:00.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
39462024-12-21T06:19:00.456ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39472024-12-21T06:19:00.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39482024-12-21T06:19:00.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39492024-12-21T06:19:00.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39502024-12-21T06:19:00.460ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39512024-12-21T06:19:00.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39522024-12-21T06:19:00.460ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39532024-12-21T06:19:00.460ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39542024-12-21T06:19:00.460ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39552024-12-21T06:19:00.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39562024-12-21T06:19:00.461ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39572024-12-21T06:19:00.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
39582024-12-21T06:19:00.464ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39592024-12-21T06:19:00.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39602024-12-21T06:19:00.466ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39612024-12-21T06:19:00.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39622024-12-21T06:19:00.467ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
39632024-12-21T06:19:00.467ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 0 version = 2
39642024-12-21T06:19:00.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39652024-12-21T06:19:00.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39662024-12-21T06:19:00.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39672024-12-21T06:19:00.468ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39682024-12-21T06:19:00.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39692024-12-21T06:19:00.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39702024-12-21T06:19:00.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39712024-12-21T06:19:00.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39722024-12-21T06:19:00.471ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39732024-12-21T06:19:00.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39742024-12-21T06:19:00.473ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 1 version = 2
39752024-12-21T06:19:00.473ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
39762024-12-21T06:19:00.473ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 06:14:08.776888 UTC dns_group = external generation = 2
39772024-12-21T06:19:00.473ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 122.794726ms iteration = 7 status = {"generation":2}
39782024-12-21T06:19:00.474ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39792024-12-21T06:19:00.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39802024-12-21T06:19:00.475ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39812024-12-21T06:19:00.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39822024-12-21T06:19:00.477ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39832024-12-21T06:19:00.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39842024-12-21T06:19:00.479ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39852024-12-21T06:19:00.482ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
39862024-12-21T06:19:00.482ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39872024-12-21T06:19:00.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39882024-12-21T06:19:00.484ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39892024-12-21T06:19:00.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39902024-12-21T06:19:00.485ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39912024-12-21T06:19:00.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39922024-12-21T06:19:00.487ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39932024-12-21T06:19:00.491ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
39942024-12-21T06:19:00.491ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
39952024-12-21T06:19:00.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
39962024-12-21T06:19:00.493ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39972024-12-21T06:19:00.493ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39982024-12-21T06:19:00.493ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.482982ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
39992024-12-21T06:19:00.497ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T06:13:58.796551Z, time_modified: 2024-12-21T06:13:58.796551Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }) }
40002024-12-21T06:19:00.497ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 146.502803ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]}},"default_endpoint":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
40012024-12-21T06:19:00.498ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40022024-12-21T06:19:00.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40032024-12-21T06:19:00.500ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40042024-12-21T06:19:00.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40052024-12-21T06:19:00.501ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
40062024-12-21T06:19:00.502ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40072024-12-21T06:19:00.502ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40082024-12-21T06:19:00.502ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40092024-12-21T06:19:00.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40102024-12-21T06:19:00.503ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0470f12-594a-42e1-b609-25c31d763efc", "content-length": "26", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} })
40112024-12-21T06:19:00.503ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40122024-12-21T06:19:00.503ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40132024-12-21T06:19:00.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40142024-12-21T06:19:00.504ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40152024-12-21T06:19:00.504ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40162024-12-21T06:19:00.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40172024-12-21T06:19:00.507ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40182024-12-21T06:19:00.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40192024-12-21T06:19:00.509ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
40202024-12-21T06:19:00.509ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40212024-12-21T06:19:00.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40222024-12-21T06:19:00.510ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40232024-12-21T06:19:00.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40242024-12-21T06:19:00.512ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40252024-12-21T06:19:00.515ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
40262024-12-21T06:19:00.515ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40272024-12-21T06:19:00.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40282024-12-21T06:19:00.517ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40292024-12-21T06:19:00.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40302024-12-21T06:19:00.543ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40312024-12-21T06:19:00.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40322024-12-21T06:19:00.557ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
40332024-12-21T06:19:00.557ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 205.931991ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
40342024-12-21T06:19:00.629ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40352024-12-21T06:19:00.629ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40362024-12-21T06:19:00.629ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c3137a3-9541-4527-b296-243be47dc358", "content-length": "26", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} })
40372024-12-21T06:19:00.629ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40382024-12-21T06:19:00.631ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40392024-12-21T06:19:00.677ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
40402024-12-21T06:19:00.677ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40412024-12-21T06:19:00.677ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0186441-23cc-4d78-afb3-b66558780b60", "content-length": "26", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} })
40422024-12-21T06:19:00.677ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40432024-12-21T06:19:00.678ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
40442024-12-21T06:19:00.678ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40452024-12-21T06:19:00.678ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf90226f-6900-4525-9ae0-b633409ce6c4", "content-length": "372", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} })
40462024-12-21T06:19:00.678ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40472024-12-21T06:19:00.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40482024-12-21T06:19:00.679ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
40492024-12-21T06:19:00.679ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40502024-12-21T06:19:00.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40512024-12-21T06:19:00.681ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40522024-12-21T06:19:00.685ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
40532024-12-21T06:19:00.685ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40542024-12-21T06:19:00.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40552024-12-21T06:19:00.691ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
40562024-12-21T06:19:00.691ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40572024-12-21T06:19:00.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40582024-12-21T06:19:00.693ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40592024-12-21T06:19:00.695ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
40602024-12-21T06:19:00.695ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
40612024-12-21T06:19:00.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
40622024-12-21T06:19:00.697ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
40632024-12-21T06:19:00.697ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
40642024-12-21T06:19:00.697ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
40652024-12-21T06:19:00.705ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
40662024-12-21T06:19:00.706ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40672024-12-21T06:19:00.708ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40682024-12-21T06:19:00.708ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40692024-12-21T06:19:00.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40702024-12-21T06:19:00.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40712024-12-21T06:19:00.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40722024-12-21T06:19:00.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40732024-12-21T06:19:00.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40742024-12-21T06:19:00.721ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
40752024-12-21T06:19:00.721ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
40762024-12-21T06:19:00.722ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c9578338-e5a1-4ecd-85dd-23eb19c25ed9", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} })
40772024-12-21T06:19:00.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40782024-12-21T06:19:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40792024-12-21T06:19:00.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40802024-12-21T06:19:00.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40812024-12-21T06:19:00.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40822024-12-21T06:19:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40832024-12-21T06:19:00.731ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40842024-12-21T06:19:00.731ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40852024-12-21T06:19:00.731ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "87710bbd-477d-468a-961d-d1f79f86e25c", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} })
40862024-12-21T06:19:00.733ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 377.397007ms iteration = 12 status = {}
40872024-12-21T06:19:00.774ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 423.017553ms iteration = 11 status = {}
40882024-12-21T06:19:00.804ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40892024-12-21T06:19:00.805ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f73482f-2515-48d5-bd16-76ce09461d27", "content-length": "1", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} })
40902024-12-21T06:19:00.806ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40912024-12-21T06:19:00.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40922024-12-21T06:19:00.808ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
40932024-12-21T06:19:00.808ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "431ee5b8-248c-4e27-a86f-dd1941534399", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40942024-12-21T06:19:00.808ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40952024-12-21T06:19:00.810ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "81a4db60-40b8-4754-aedc-d0d404446d2b", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40962024-12-21T06:19:00.810ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40972024-12-21T06:19:00.812ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40982024-12-21T06:19:00.812ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 461.180501ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
40992024-12-21T06:19:00.824ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: cf7f8320-e45e-46f1-aa3b-b101ce937c63, time_created: 2024-12-21T06:14:06.164830Z, time_modified: 2024-12-21T06:14:06.164830Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
41002024-12-21T06:19:00.824ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
41012024-12-21T06:19:00.824ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41022024-12-21T06:19:00.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41032024-12-21T06:19:00.832ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
41042024-12-21T06:19:00.832ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f31d3002-19c8-4648-a058-7bf49f23abc9", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41052024-12-21T06:19:00.832ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41062024-12-21T06:19:00.835ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "63016cbd-443f-4beb-9270-000b30822d60", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41072024-12-21T06:19:00.835ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41082024-12-21T06:19:00.837ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "01d72813-08e2-469c-9700-b0f90fbf50d6", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41092024-12-21T06:19:00.837ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41102024-12-21T06:19:00.839ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
41112024-12-21T06:19:00.839ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 488.220091ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
41122024-12-21T06:19:00.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f3a5f021-e216-49a3-abe9-5066cbaa2ef3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41132024-12-21T06:19:00.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f3a5f021-e216-49a3-abe9-5066cbaa2ef3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41142024-12-21T06:19:00.861ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41152024-12-21T06:19:00.862ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff5f342b-0588-4816-9f4e-af57bcd1a221", "content-length": "691", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} })
41162024-12-21T06:19:00.862ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
41172024-12-21T06:19:00.862ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
41182024-12-21T06:19:00.862ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
41192024-12-21T06:19:00.863ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 512.264677ms iteration = 11 status = {}
41202024-12-21T06:19:00.863ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 513.055329ms iteration = 11 status = null
41212024-12-21T06:19:00.864ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
41222024-12-21T06:19:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
41232024-12-21T06:19:00.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f3a5f021-e216-49a3-abe9-5066cbaa2ef3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41242024-12-21T06:19:00.866ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41252024-12-21T06:19:00.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
41262024-12-21T06:19:00.930ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
41272024-12-21T06:19:00.931ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "7918ed99-b26a-456c-8d8f-c0d24ff77741", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} })
41282024-12-21T06:19:00.933ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
41292024-12-21T06:19:00.933ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 577.423655ms
41302024-12-21T06:19:00.933ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 577.434135ms iteration = 2 status = {}
41312024-12-21T06:19:00.936ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41322024-12-21T06:19:00.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41332024-12-21T06:19:00.939ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
41342024-12-21T06:19:00.939ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41352024-12-21T06:19:00.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41362024-12-21T06:19:00.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 42e4c634-c537-47ee-a869-5b4fbba85bc1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
41372024-12-21T06:19:00.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 42e4c634-c537-47ee-a869-5b4fbba85bc1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
41382024-12-21T06:19:00.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 42e4c634-c537-47ee-a869-5b4fbba85bc1 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
41392024-12-21T06:19:00.949ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41402024-12-21T06:19:00.949ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a34b171-ed81-40c2-bc45-4c8874b30bf7", "content-length": "134", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} })
41412024-12-21T06:19:00.949ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41422024-12-21T06:19:00.949ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
41432024-12-21T06:19:00.949ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41442024-12-21T06:19:00.949ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41452024-12-21T06:19:00.949ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41462024-12-21T06:19:00.949ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41472024-12-21T06:19:00.949ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41482024-12-21T06:19:00.949ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41492024-12-21T06:19:00.949ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41502024-12-21T06:19:00.949ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41512024-12-21T06:19:00.950ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
41522024-12-21T06:19:00.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41532024-12-21T06:19:00.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41542024-12-21T06:19:00.952ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41552024-12-21T06:19:00.952ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7037a896-3a23-42dd-b494-794259e802bc", "content-length": "2", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} })
41562024-12-21T06:19:00.952ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41572024-12-21T06:19:00.952ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4a860fc-03ae-4363-b6dd-e2e7f2d7d8ff", "content-length": "52", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} })
41582024-12-21T06:19:00.952ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
41592024-12-21T06:19:00.952ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41602024-12-21T06:19:01.046ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b5255e00-86cb-49f5-8fe7-8c92044b32f4", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} })
41612024-12-21T06:19:01.046ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
41622024-12-21T06:19:01.046ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41632024-12-21T06:19:01.046ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "432515d6-2049-4a1a-9074-df6c2330b1f2", "content-length": "682", "date": "Sat, 21 Dec 2024 06:19:00 GMT"} })
41642024-12-21T06:19:01.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41652024-12-21T06:19:01.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41662024-12-21T06:19:01.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41672024-12-21T06:19:01.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41682024-12-21T06:19:01.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41692024-12-21T06:19:01.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41702024-12-21T06:19:01.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41712024-12-21T06:19:01.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41722024-12-21T06:19:01.062ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 711.835883ms iteration = 11 status = {}
41732024-12-21T06:19:01.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 96a9663b-5a9f-4b8a-9d26-6c5680a5d0fc roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41742024-12-21T06:19:01.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 96a9663b-5a9f-4b8a-9d26-6c5680a5d0fc resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41752024-12-21T06:19:01.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 96a9663b-5a9f-4b8a-9d26-6c5680a5d0fc response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41762024-12-21T06:19:02.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 198f32c1-ffc8-44af-b486-3526971102bd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41772024-12-21T06:19:02.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 198f32c1-ffc8-44af-b486-3526971102bd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41782024-12-21T06:19:02.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 198f32c1-ffc8-44af-b486-3526971102bd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41792024-12-21T06:19:03.057ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:44808
41802024-12-21T06:19:03.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44808 req_id = fdb8f054-7469-454f-845c-d4a10999cb81 roles = RoleSet { roles: {} } uri = /metrics/producers
41812024-12-21T06:19:03.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44808 req_id = fdb8f054-7469-454f-845c-d4a10999cb81 resource = Database result = Ok(()) uri = /metrics/producers
41822024-12-21T06:19:03.098ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 98955a77-d432-4135-98da-54d3ff354ace
41832024-12-21T06:19:03.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40379 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44808 req_id = fdb8f054-7469-454f-845c-d4a10999cb81 response_code = 201 uri = /metrics/producers
41842024-12-21T06:19:03.694ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:63318
41852024-12-21T06:19:03.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63318 req_id = ccc1e7b6-e367-466b-975b-14111dea5c5f roles = RoleSet { roles: {} } uri = /metrics/producers
41862024-12-21T06:19:03.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63318 req_id = ccc1e7b6-e367-466b-975b-14111dea5c5f resource = Database result = Ok(()) uri = /metrics/producers
41872024-12-21T06:19:03.735ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = d1b17d65-9e31-4f7b-88f5-d7566540099b
41882024-12-21T06:19:03.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41080 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63318 req_id = ccc1e7b6-e367-466b-975b-14111dea5c5f response_code = 201 uri = /metrics/producers
41892024-12-21T06:19:03.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c6364a4c-6d25-49a1-925c-e93bb2a65e50 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41902024-12-21T06:19:03.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c6364a4c-6d25-49a1-925c-e93bb2a65e50 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41912024-12-21T06:19:03.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c6364a4c-6d25-49a1-925c-e93bb2a65e50 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41922024-12-21T06:19:03.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1235 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 81fb5c6f-5c33-43df-b432-e992fe0b08bc response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
41932024-12-21T06:19:04.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ecfdcb28-1ef6-451f-a23c-deaad8fd4736 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41942024-12-21T06:19:04.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ecfdcb28-1ef6-451f-a23c-deaad8fd4736 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41952024-12-21T06:19:04.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ecfdcb28-1ef6-451f-a23c-deaad8fd4736 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
41962024-12-21T06:19:05.433ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:43958
41972024-12-21T06:19:05.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43958 req_id = 68c14856-845e-492b-bab6-b6627b3eecec roles = RoleSet { roles: {} } uri = /metrics/producers
41982024-12-21T06:19:05.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43958 req_id = 68c14856-845e-492b-bab6-b6627b3eecec resource = Database result = Ok(()) uri = /metrics/producers
41992024-12-21T06:19:05.467ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 0816076d-2e0e-472b-89a8-a9ecbfd48b43
42002024-12-21T06:19:05.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34324 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43958 req_id = 68c14856-845e-492b-bab6-b6627b3eecec response_code = 201 uri = /metrics/producers
42012024-12-21T06:19:05.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 32213860-b1e1-44fb-9909-958abeff8c86 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42022024-12-21T06:19:05.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 32213860-b1e1-44fb-9909-958abeff8c86 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42032024-12-21T06:19:05.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2699 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 32213860-b1e1-44fb-9909-958abeff8c86 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42042024-12-21T06:19:06.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c27c2d03-e02f-422b-94db-1a41acfc2cfe roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42052024-12-21T06:19:06.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c27c2d03-e02f-422b-94db-1a41acfc2cfe resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42062024-12-21T06:19:06.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c27c2d03-e02f-422b-94db-1a41acfc2cfe response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42072024-12-21T06:19:07.560ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:43737
42082024-12-21T06:19:07.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43737 req_id = db932cb5-2a5c-493e-b8f3-31419d41c9f5 roles = RoleSet { roles: {} } uri = /metrics/producers
42092024-12-21T06:19:07.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43737 req_id = db932cb5-2a5c-493e-b8f3-31419d41c9f5 resource = Database result = Ok(()) uri = /metrics/producers
42102024-12-21T06:19:07.598ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
42112024-12-21T06:19:07.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37792 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43737 req_id = db932cb5-2a5c-493e-b8f3-31419d41c9f5 response_code = 201 uri = /metrics/producers
42122024-12-21T06:19:08.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dc888f04-6c0d-4c1e-95d5-7ae1a0be2044 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42132024-12-21T06:19:08.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dc888f04-6c0d-4c1e-95d5-7ae1a0be2044 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42142024-12-21T06:19:08.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dc888f04-6c0d-4c1e-95d5-7ae1a0be2044 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42152024-12-21T06:19:09.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e72fc2ac-7b58-432a-ad89-ac1276245f38 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42162024-12-21T06:19:09.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e72fc2ac-7b58-432a-ad89-ac1276245f38 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42172024-12-21T06:19:09.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e72fc2ac-7b58-432a-ad89-ac1276245f38 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42182024-12-21T06:19:10.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7193ae2d-eda5-4c01-9b45-30779a3fe6ba roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42192024-12-21T06:19:10.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7193ae2d-eda5-4c01-9b45-30779a3fe6ba resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42202024-12-21T06:19:10.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7193ae2d-eda5-4c01-9b45-30779a3fe6ba response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42212024-12-21T06:19:10.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
42222024-12-21T06:19:10.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42232024-12-21T06:19:10.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42242024-12-21T06:19:10.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
42252024-12-21T06:19:10.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42262024-12-21T06:19:10.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42272024-12-21T06:19:10.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42282024-12-21T06:19:10.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42292024-12-21T06:19:10.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42302024-12-21T06:19:10.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42312024-12-21T06:19:10.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42322024-12-21T06:19:10.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42332024-12-21T06:19:10.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42342024-12-21T06:19:10.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
42352024-12-21T06:19:10.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42362024-12-21T06:19:10.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42372024-12-21T06:19:10.370ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
42382024-12-21T06:19:10.370ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.630864ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
42392024-12-21T06:19:10.379ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42402024-12-21T06:19:10.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42412024-12-21T06:19:10.410ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.647614ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42422024-12-21T06:19:10.460ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
42432024-12-21T06:19:10.460ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
42442024-12-21T06:19:10.490ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
42452024-12-21T06:19:10.490ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:61529
42462024-12-21T06:19:10.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61529 req_id = 74d82313-f7d7-40ca-80f4-9989047e2170 roles = RoleSet { roles: {} } uri = /metrics/producers
42472024-12-21T06:19:10.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61529 req_id = 74d82313-f7d7-40ca-80f4-9989047e2170 resource = Database result = Ok(()) uri = /metrics/producers
42482024-12-21T06:19:10.500ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
42492024-12-21T06:19:10.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9714 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:61529 req_id = 74d82313-f7d7-40ca-80f4-9989047e2170 response_code = 201 uri = /metrics/producers
42502024-12-21T06:19:10.500ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "74d82313-f7d7-40ca-80f4-9989047e2170", "content-length": "41", "date": "Sat, 21 Dec 2024 06:19:10 GMT"} })
42512024-12-21T06:19:10.501ZDEBGnexus (producer-registration-task): registered with nexus successfully
42522024-12-21T06:19:10.501ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
42532024-12-21T06:19:11.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1c380774-83d6-4d67-a3ac-862732868947 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42542024-12-21T06:19:11.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1c380774-83d6-4d67-a3ac-862732868947 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42552024-12-21T06:19:11.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1c380774-83d6-4d67-a3ac-862732868947 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42562024-12-21T06:19:12.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d448b264-aaf5-47b9-8494-55e7842b68ed roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42572024-12-21T06:19:12.098ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d448b264-aaf5-47b9-8494-55e7842b68ed resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42582024-12-21T06:19:12.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d448b264-aaf5-47b9-8494-55e7842b68ed response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42592024-12-21T06:19:13.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9c3d1974-721a-411d-b176-c4438babc23a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42602024-12-21T06:19:13.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9c3d1974-721a-411d-b176-c4438babc23a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42612024-12-21T06:19:13.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9c3d1974-721a-411d-b176-c4438babc23a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42622024-12-21T06:19:13.150ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:48197
42632024-12-21T06:19:13.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48197 req_id = 6eb3a07a-b712-4407-b4e3-33cbcaaae9f4 roles = RoleSet { roles: {} } uri = /metrics/producers
42642024-12-21T06:19:13.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48197 req_id = 6eb3a07a-b712-4407-b4e3-33cbcaaae9f4 resource = Database result = Ok(()) uri = /metrics/producers
42652024-12-21T06:19:13.160ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 49f39df6-9f0d-49d5-a626-07ee31ec1ff4
42662024-12-21T06:19:13.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10218 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48197 req_id = 6eb3a07a-b712-4407-b4e3-33cbcaaae9f4 response_code = 201 uri = /metrics/producers
42672024-12-21T06:19:13.596ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35560
42682024-12-21T06:19:13.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35560 req_id = d2f2b99a-563a-4ead-a66d-ade530bb2710 roles = RoleSet { roles: {} } uri = /metrics/producers
42692024-12-21T06:19:13.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35560 req_id = d2f2b99a-563a-4ead-a66d-ade530bb2710 resource = Database result = Ok(()) uri = /metrics/producers
42702024-12-21T06:19:13.606ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 47090b0b-c8ad-4dca-92e5-38fed29ad6d5
42712024-12-21T06:19:13.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9943 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35560 req_id = d2f2b99a-563a-4ead-a66d-ade530bb2710 response_code = 201 uri = /metrics/producers
42722024-12-21T06:19:13.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1404 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = c88d258f-18ea-4d65-a58c-cc7fb694c338 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
42732024-12-21T06:19:14.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = aa5ebd44-ec7e-4669-a9e0-bdac15b8c6e7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42742024-12-21T06:19:14.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = aa5ebd44-ec7e-4669-a9e0-bdac15b8c6e7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42752024-12-21T06:19:14.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = aa5ebd44-ec7e-4669-a9e0-bdac15b8c6e7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42762024-12-21T06:19:15.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c3fe07fb-e310-49fd-ace3-b5232887bcef roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42772024-12-21T06:19:15.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c3fe07fb-e310-49fd-ace3-b5232887bcef resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42782024-12-21T06:19:15.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c3fe07fb-e310-49fd-ace3-b5232887bcef response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42792024-12-21T06:19:16.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 284494da-a678-4de5-a746-d32d7c0b1e81 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42802024-12-21T06:19:16.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 284494da-a678-4de5-a746-d32d7c0b1e81 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42812024-12-21T06:19:16.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 284494da-a678-4de5-a746-d32d7c0b1e81 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42822024-12-21T06:19:17.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bb33a252-da2e-42a3-9f9a-98aaecdde5ec roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42832024-12-21T06:19:17.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bb33a252-da2e-42a3-9f9a-98aaecdde5ec resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42842024-12-21T06:19:17.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5167 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bb33a252-da2e-42a3-9f9a-98aaecdde5ec response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42852024-12-21T06:19:18.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 992c7096-44a6-4d25-a29d-ee4d2ce1e16c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42862024-12-21T06:19:18.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 992c7096-44a6-4d25-a29d-ee4d2ce1e16c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42872024-12-21T06:19:18.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 992c7096-44a6-4d25-a29d-ee4d2ce1e16c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42882024-12-21T06:19:19.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = aa2e89cd-cf9e-49b7-bcd2-c8237667ca11 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42892024-12-21T06:19:19.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = aa2e89cd-cf9e-49b7-bcd2-c8237667ca11 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42902024-12-21T06:19:19.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = aa2e89cd-cf9e-49b7-bcd2-c8237667ca11 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42912024-12-21T06:19:20.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f793819b-4b66-429c-8a66-7fa40be0cc85 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42922024-12-21T06:19:20.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f793819b-4b66-429c-8a66-7fa40be0cc85 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42932024-12-21T06:19:20.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f793819b-4b66-429c-8a66-7fa40be0cc85 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
42942024-12-21T06:19:20.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
42952024-12-21T06:19:20.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42962024-12-21T06:19:20.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42972024-12-21T06:19:20.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
42982024-12-21T06:19:20.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42992024-12-21T06:19:20.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43002024-12-21T06:19:20.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43012024-12-21T06:19:20.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43022024-12-21T06:19:20.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43032024-12-21T06:19:20.354ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.368363ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43042024-12-21T06:19:20.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43052024-12-21T06:19:20.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43062024-12-21T06:19:20.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43072024-12-21T06:19:20.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43082024-12-21T06:19:20.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43092024-12-21T06:19:20.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43102024-12-21T06:19:20.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
43112024-12-21T06:19:20.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43122024-12-21T06:19:20.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43132024-12-21T06:19:20.368ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
43142024-12-21T06:19:20.368ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.996489ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
43152024-12-21T06:19:21.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c3f835e5-1937-4c65-8ac1-aea845715ff8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43162024-12-21T06:19:21.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c3f835e5-1937-4c65-8ac1-aea845715ff8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43172024-12-21T06:19:21.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1704 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c3f835e5-1937-4c65-8ac1-aea845715ff8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43182024-12-21T06:19:22.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd488e13-f5f7-4d11-a68a-4a576c28ad19 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43192024-12-21T06:19:22.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd488e13-f5f7-4d11-a68a-4a576c28ad19 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43202024-12-21T06:19:22.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd488e13-f5f7-4d11-a68a-4a576c28ad19 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43212024-12-21T06:19:23.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c8ddc2b5-25b5-49c1-801d-41719a4bb702 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43222024-12-21T06:19:23.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c8ddc2b5-25b5-49c1-801d-41719a4bb702 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43232024-12-21T06:19:23.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c8ddc2b5-25b5-49c1-801d-41719a4bb702 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43242024-12-21T06:19:23.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1210 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = c9010b4e-63d5-4253-9a20-b613eed726ab response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
43252024-12-21T06:19:24.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 55a9b8f3-6206-4c10-8b57-e9a074a6f973 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43262024-12-21T06:19:24.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 55a9b8f3-6206-4c10-8b57-e9a074a6f973 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43272024-12-21T06:19:24.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2099 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 55a9b8f3-6206-4c10-8b57-e9a074a6f973 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43282024-12-21T06:19:25.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 15fce750-a378-4549-9454-984ebd1c382d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43292024-12-21T06:19:25.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 15fce750-a378-4549-9454-984ebd1c382d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43302024-12-21T06:19:25.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 15fce750-a378-4549-9454-984ebd1c382d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43312024-12-21T06:19:26.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 015449c6-8658-4ed0-9aa4-afffc989f964 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43322024-12-21T06:19:26.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 015449c6-8658-4ed0-9aa4-afffc989f964 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43332024-12-21T06:19:26.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 015449c6-8658-4ed0-9aa4-afffc989f964 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43342024-12-21T06:19:27.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fa7e3708-5623-4e38-b7aa-21fcd79138c4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43352024-12-21T06:19:27.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fa7e3708-5623-4e38-b7aa-21fcd79138c4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43362024-12-21T06:19:27.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fa7e3708-5623-4e38-b7aa-21fcd79138c4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43372024-12-21T06:19:28.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e42b9054-1124-4626-b372-c28a9d37d990 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43382024-12-21T06:19:28.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e42b9054-1124-4626-b372-c28a9d37d990 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43392024-12-21T06:19:28.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e42b9054-1124-4626-b372-c28a9d37d990 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43402024-12-21T06:19:29.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bdcda80c-f9fc-4f91-8e30-121bc12cc478 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43412024-12-21T06:19:29.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bdcda80c-f9fc-4f91-8e30-121bc12cc478 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43422024-12-21T06:19:29.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bdcda80c-f9fc-4f91-8e30-121bc12cc478 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
43432024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
43442024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
43452024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43462024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
43472024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
43482024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
43492024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43502024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43512024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43522024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43532024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
43542024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
43552024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
43562024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
43572024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43582024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43592024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43602024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
43612024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
43622024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43632024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43642024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
43652024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43662024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
43672024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43682024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
43692024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43702024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43712024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43722024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43732024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43742024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43752024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43762024-12-21T06:19:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43772024-12-21T06:19:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43782024-12-21T06:19:30.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43792024-12-21T06:19:30.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1301, tv_nsec: 438428956 } })
43802024-12-21T06:19:30.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
43812024-12-21T06:19:30.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1301, tv_nsec: 438913610 } })
43822024-12-21T06:19:30.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
43832024-12-21T06:19:30.354ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.94976ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43842024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43852024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43862024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43872024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
43882024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43892024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
43902024-12-21T06:19:30.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
43912024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
43922024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43932024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
43942024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43952024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43962024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
43972024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
43982024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43992024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
44002024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44012024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
44022024-12-21T06:19:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44032024-12-21T06:19:30.357ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44042024-12-21T06:19:30.359ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44052024-12-21T06:19:30.359ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44062024-12-21T06:19:30.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44072024-12-21T06:19:30.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44082024-12-21T06:19:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44092024-12-21T06:19:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
44102024-12-21T06:19:30.361ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44112024-12-21T06:19:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44122024-12-21T06:19:30.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
44132024-12-21T06:19:30.362ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
44142024-12-21T06:19:30.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
44152024-12-21T06:19:30.364ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44162024-12-21T06:19:30.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44172024-12-21T06:19:30.367ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44182024-12-21T06:19:30.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44192024-12-21T06:19:30.367ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44202024-12-21T06:19:30.367ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44212024-12-21T06:19:30.367ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44222024-12-21T06:19:30.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44232024-12-21T06:19:30.382ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44242024-12-21T06:19:30.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44252024-12-21T06:19:30.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44262024-12-21T06:19:30.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44272024-12-21T06:19:30.399ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44282024-12-21T06:19:30.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44292024-12-21T06:19:30.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44302024-12-21T06:19:30.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44312024-12-21T06:19:30.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44322024-12-21T06:19:30.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
44332024-12-21T06:19:30.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44342024-12-21T06:19:30.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44352024-12-21T06:19:30.401ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.372267ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44362024-12-21T06:19:30.402ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
44372024-12-21T06:19:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
44382024-12-21T06:19:30.403ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1301, tv_nsec: 487897578 } })
44392024-12-21T06:19:30.403ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
44402024-12-21T06:19:30.403ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44412024-12-21T06:19:30.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44422024-12-21T06:19:30.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44432024-12-21T06:19:30.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44442024-12-21T06:19:30.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44452024-12-21T06:19:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44462024-12-21T06:19:30.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44472024-12-21T06:19:30.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44482024-12-21T06:19:30.408ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44492024-12-21T06:19:30.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44502024-12-21T06:19:30.408ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44512024-12-21T06:19:30.409ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.801835ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
44522024-12-21T06:19:30.409ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44532024-12-21T06:19:30.409ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44542024-12-21T06:19:30.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44552024-12-21T06:19:30.411ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44562024-12-21T06:19:30.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44572024-12-21T06:19:30.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44582024-12-21T06:19:30.412ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44592024-12-21T06:19:30.412ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44602024-12-21T06:19:30.412ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 60.90883ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44612024-12-21T06:19:30.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
44622024-12-21T06:19:30.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44632024-12-21T06:19:30.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44642024-12-21T06:19:30.418ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44652024-12-21T06:19:30.418ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44662024-12-21T06:19:30.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44672024-12-21T06:19:30.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44682024-12-21T06:19:30.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44692024-12-21T06:19:30.420ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44702024-12-21T06:19:30.420ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.24679ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44712024-12-21T06:19:30.421ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 65.158517ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
44722024-12-21T06:19:30.421ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44732024-12-21T06:19:30.421ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44742024-12-21T06:19:30.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44752024-12-21T06:19:30.434ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
44762024-12-21T06:19:30.434ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44772024-12-21T06:19:30.434ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a10e5cd-52d0-4fa6-9b00-f8302474db67", "content-length": "26", "date": "Sat, 21 Dec 2024 06:19:30 GMT"} })
44782024-12-21T06:19:30.434ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44792024-12-21T06:19:30.437ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44802024-12-21T06:19:30.438ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
44812024-12-21T06:19:30.438ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.54287ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
44822024-12-21T06:19:30.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.423376ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44832024-12-21T06:19:30.453ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 97.532315ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
44842024-12-21T06:19:30.457ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
44852024-12-21T06:19:30.457ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44862024-12-21T06:19:30.457ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44872024-12-21T06:19:30.457ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "888af4ee-3a14-49c3-bea7-0d4f2c145392", "content-length": "26", "date": "Sat, 21 Dec 2024 06:19:30 GMT"} })
44882024-12-21T06:19:30.457ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44892024-12-21T06:19:30.458ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.812203ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44902024-12-21T06:19:30.458ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44912024-12-21T06:19:30.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
44922024-12-21T06:19:30.460ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44932024-12-21T06:19:30.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44942024-12-21T06:19:30.460ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 109.170868ms iteration = 15 status = {"physical_disks_added":0}
44952024-12-21T06:19:30.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95ea2b13-e56b-42ff-8c86-0a180cc7dea3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
44962024-12-21T06:19:30.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95ea2b13-e56b-42ff-8c86-0a180cc7dea3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
44972024-12-21T06:19:30.493ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44982024-12-21T06:19:30.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44992024-12-21T06:19:30.551ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45002024-12-21T06:19:30.551ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45012024-12-21T06:19:30.551ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b161f75c-b72a-4eea-b1e2-39c99189d256", "content-length": "372", "date": "Sat, 21 Dec 2024 06:19:30 GMT"} })
45022024-12-21T06:19:30.551ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45032024-12-21T06:19:30.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45042024-12-21T06:19:30.553ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 202.283871ms iteration = 12 status = 0
45052024-12-21T06:19:30.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95ea2b13-e56b-42ff-8c86-0a180cc7dea3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
45062024-12-21T06:19:30.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45072024-12-21T06:19:30.582ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 231.439259ms iteration = 12 status = {}
45082024-12-21T06:19:30.583ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45092024-12-21T06:19:30.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45102024-12-21T06:19:30.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45112024-12-21T06:19:30.595ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
45122024-12-21T06:19:30.595ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45132024-12-21T06:19:30.595ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2b12f039-b480-490c-a662-24c8948f27ca", "date": "Sat, 21 Dec 2024 06:19:30 GMT"} })
45142024-12-21T06:19:30.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45152024-12-21T06:19:30.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45162024-12-21T06:19:30.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45172024-12-21T06:19:30.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45182024-12-21T06:19:30.601ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45192024-12-21T06:19:30.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45202024-12-21T06:19:30.601ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
45212024-12-21T06:19:30.602ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45222024-12-21T06:19:30.602ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c31bc7fb-a729-4ddd-98bc-1ab3d517c349", "content-length": "26", "date": "Sat, 21 Dec 2024 06:19:30 GMT"} })
45232024-12-21T06:19:30.602ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45242024-12-21T06:19:30.603ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45252024-12-21T06:19:30.603ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45262024-12-21T06:19:30.604ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0d6dc50b-fbee-4907-9c9a-c5a84ff1fb78", "date": "Sat, 21 Dec 2024 06:19:30 GMT"} })
45272024-12-21T06:19:30.604ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
45282024-12-21T06:19:30.606ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 249.704466ms iteration = 13 status = {}
45292024-12-21T06:19:30.609ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45302024-12-21T06:19:30.609ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f1ec540-4a4e-44fd-a3b3-8c83f0007bf2", "content-length": "1", "date": "Sat, 21 Dec 2024 06:19:30 GMT"} })
45312024-12-21T06:19:30.611ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45322024-12-21T06:19:30.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45332024-12-21T06:19:30.611ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45342024-12-21T06:19:30.613ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 262.305665ms iteration = 12 status = null
45352024-12-21T06:19:30.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45362024-12-21T06:19:30.613ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45372024-12-21T06:19:30.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45382024-12-21T06:19:30.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45392024-12-21T06:19:30.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45402024-12-21T06:19:30.724ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45412024-12-21T06:19:30.725ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a71fb706-f9f9-4dff-9434-e225ef2c3987", "content-length": "691", "date": "Sat, 21 Dec 2024 06:19:30 GMT"} })
45422024-12-21T06:19:30.725ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
45432024-12-21T06:19:30.725ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
45442024-12-21T06:19:30.725ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
45452024-12-21T06:19:30.725ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
45462024-12-21T06:19:30.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45472024-12-21T06:19:30.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45482024-12-21T06:19:30.726ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 375.323619ms iteration = 12 status = {}
45492024-12-21T06:19:30.735ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
45502024-12-21T06:19:30.735ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f587fd13-a013-490b-87b5-1dc64325b101", "content-length": "134", "date": "Sat, 21 Dec 2024 06:19:30 GMT"} })
45512024-12-21T06:19:30.735ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
45522024-12-21T06:19:30.735ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
45532024-12-21T06:19:30.735ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
45542024-12-21T06:19:30.735ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
45552024-12-21T06:19:30.735ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45562024-12-21T06:19:30.735ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45572024-12-21T06:19:30.735ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45582024-12-21T06:19:30.735ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45592024-12-21T06:19:30.735ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
45602024-12-21T06:19:30.735ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
45612024-12-21T06:19:30.736ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
45622024-12-21T06:19:30.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45632024-12-21T06:19:30.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45642024-12-21T06:19:30.738ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
45652024-12-21T06:19:30.738ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "641831bf-d2cb-4f9a-ad8b-ca9a18786d86", "content-length": "2", "date": "Sat, 21 Dec 2024 06:19:30 GMT"} })
45662024-12-21T06:19:30.738ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
45672024-12-21T06:19:30.738ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e24e2895-8cf3-48d8-8b90-b19257281cb7", "content-length": "52", "date": "Sat, 21 Dec 2024 06:19:30 GMT"} })
45682024-12-21T06:19:30.738ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
45692024-12-21T06:19:30.738ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
45702024-12-21T06:19:30.829ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "90efe215-7c79-4e07-927b-b21b63845ff1", "date": "Sat, 21 Dec 2024 06:19:30 GMT"} })
45712024-12-21T06:19:30.829ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
45722024-12-21T06:19:30.829ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
45732024-12-21T06:19:30.830ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d45d22c-d074-48ba-b12b-060a5f8fe157", "content-length": "682", "date": "Sat, 21 Dec 2024 06:19:30 GMT"} })
45742024-12-21T06:19:30.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45752024-12-21T06:19:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45762024-12-21T06:19:30.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45772024-12-21T06:19:30.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45782024-12-21T06:19:30.836ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45792024-12-21T06:19:30.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45802024-12-21T06:19:30.839ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45812024-12-21T06:19:30.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45822024-12-21T06:19:30.846ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 494.966287ms iteration = 12 status = {}
45832024-12-21T06:19:30.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 53d2fc9d-8bdc-4b6e-8809-9cbdb3ac88f0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
45842024-12-21T06:19:30.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 53d2fc9d-8bdc-4b6e-8809-9cbdb3ac88f0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
45852024-12-21T06:19:30.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 53d2fc9d-8bdc-4b6e-8809-9cbdb3ac88f0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
45862024-12-21T06:19:31.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 80c96414-338e-4357-8907-f2b13a6d9743 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
45872024-12-21T06:19:31.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 80c96414-338e-4357-8907-f2b13a6d9743 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
45882024-12-21T06:19:31.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 80c96414-338e-4357-8907-f2b13a6d9743 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
45892024-12-21T06:19:32.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 24bd782b-6462-4d7f-99bd-9463ed4209e9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
45902024-12-21T06:19:32.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 24bd782b-6462-4d7f-99bd-9463ed4209e9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
45912024-12-21T06:19:32.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 24bd782b-6462-4d7f-99bd-9463ed4209e9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
45922024-12-21T06:19:33.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3d2acdb7-7ebd-4d15-a0e8-c74a810a2bab roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
45932024-12-21T06:19:33.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3d2acdb7-7ebd-4d15-a0e8-c74a810a2bab resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
45942024-12-21T06:19:33.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2501 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3d2acdb7-7ebd-4d15-a0e8-c74a810a2bab response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
45952024-12-21T06:19:33.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1411 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = cc29488b-33c3-4bf5-ae70-d7c758ae5de4 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
45962024-12-21T06:19:34.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 27ba5378-215a-4c5c-ae52-8f067f561d45 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
45972024-12-21T06:19:34.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 27ba5378-215a-4c5c-ae52-8f067f561d45 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
45982024-12-21T06:19:34.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 27ba5378-215a-4c5c-ae52-8f067f561d45 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
45992024-12-21T06:19:35.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f05f7974-0b54-4b72-834e-494f09db29e1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46002024-12-21T06:19:35.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f05f7974-0b54-4b72-834e-494f09db29e1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46012024-12-21T06:19:35.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2644 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f05f7974-0b54-4b72-834e-494f09db29e1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46022024-12-21T06:19:36.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bcc1d872-79bd-4232-b4f0-d3fc9989bf60 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46032024-12-21T06:19:36.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bcc1d872-79bd-4232-b4f0-d3fc9989bf60 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46042024-12-21T06:19:36.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bcc1d872-79bd-4232-b4f0-d3fc9989bf60 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46052024-12-21T06:19:37.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26b27337-925e-479f-b839-34cab8ab32b0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46062024-12-21T06:19:37.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26b27337-925e-479f-b839-34cab8ab32b0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46072024-12-21T06:19:37.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26b27337-925e-479f-b839-34cab8ab32b0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46082024-12-21T06:19:38.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3903d429-9093-4f6b-8fb8-8365462159b2 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46092024-12-21T06:19:38.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3903d429-9093-4f6b-8fb8-8365462159b2 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46102024-12-21T06:19:38.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3903d429-9093-4f6b-8fb8-8365462159b2 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46112024-12-21T06:19:39.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e5435e5e-b00f-4fb7-a300-d41e934d0183 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46122024-12-21T06:19:39.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e5435e5e-b00f-4fb7-a300-d41e934d0183 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46132024-12-21T06:19:39.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e5435e5e-b00f-4fb7-a300-d41e934d0183 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46142024-12-21T06:19:40.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
46152024-12-21T06:19:40.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46162024-12-21T06:19:40.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46172024-12-21T06:19:40.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
46182024-12-21T06:19:40.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46192024-12-21T06:19:40.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46202024-12-21T06:19:40.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46212024-12-21T06:19:40.388ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46222024-12-21T06:19:40.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46232024-12-21T06:19:40.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46242024-12-21T06:19:40.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46252024-12-21T06:19:40.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46262024-12-21T06:19:40.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46272024-12-21T06:19:40.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46282024-12-21T06:19:40.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46292024-12-21T06:19:40.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
46302024-12-21T06:19:40.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46312024-12-21T06:19:40.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46322024-12-21T06:19:40.407ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
46332024-12-21T06:19:40.407ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 57.292729ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
46342024-12-21T06:19:40.416ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.095825ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46352024-12-21T06:19:40.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 277b85ef-6cc7-40e2-af1c-d61767403ada roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46362024-12-21T06:19:40.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 277b85ef-6cc7-40e2-af1c-d61767403ada resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46372024-12-21T06:19:40.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 277b85ef-6cc7-40e2-af1c-d61767403ada response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46382024-12-21T06:19:41.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4d9011fc-af1a-4bcd-962a-2e58951e2696 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46392024-12-21T06:19:41.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4d9011fc-af1a-4bcd-962a-2e58951e2696 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46402024-12-21T06:19:41.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4d9011fc-af1a-4bcd-962a-2e58951e2696 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46412024-12-21T06:19:42.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd77a4a1-b31f-4276-b28d-180d5ec8e817 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46422024-12-21T06:19:42.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd77a4a1-b31f-4276-b28d-180d5ec8e817 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46432024-12-21T06:19:42.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd77a4a1-b31f-4276-b28d-180d5ec8e817 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46442024-12-21T06:19:43.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bd4120b7-eff8-4d6f-ad52-dedaa247b82a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46452024-12-21T06:19:43.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bd4120b7-eff8-4d6f-ad52-dedaa247b82a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46462024-12-21T06:19:43.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bd4120b7-eff8-4d6f-ad52-dedaa247b82a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46472024-12-21T06:19:43.970ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = c0cb5931-bd4a-46f3-915a-163e7e3e49ae response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
46482024-12-21T06:19:44.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fda0c03e-5e6e-4a64-a3a3-4e9b87434c22 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46492024-12-21T06:19:44.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fda0c03e-5e6e-4a64-a3a3-4e9b87434c22 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46502024-12-21T06:19:44.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fda0c03e-5e6e-4a64-a3a3-4e9b87434c22 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46512024-12-21T06:19:45.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 75778a4e-31f4-4cba-8ff8-447d92f21c49 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46522024-12-21T06:19:45.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 75778a4e-31f4-4cba-8ff8-447d92f21c49 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46532024-12-21T06:19:45.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1640 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 75778a4e-31f4-4cba-8ff8-447d92f21c49 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46542024-12-21T06:19:46.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 80c3918b-525a-4c6a-a049-41d28bed137c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46552024-12-21T06:19:46.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 80c3918b-525a-4c6a-a049-41d28bed137c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46562024-12-21T06:19:46.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 80c3918b-525a-4c6a-a049-41d28bed137c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46572024-12-21T06:19:47.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 620160f6-cfdb-4d26-9123-b12a0e566a2a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46582024-12-21T06:19:47.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 620160f6-cfdb-4d26-9123-b12a0e566a2a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46592024-12-21T06:19:47.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 620160f6-cfdb-4d26-9123-b12a0e566a2a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46602024-12-21T06:19:48.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4d836a1c-e1af-4093-a357-79dd303872e9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46612024-12-21T06:19:48.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4d836a1c-e1af-4093-a357-79dd303872e9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46622024-12-21T06:19:48.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4d836a1c-e1af-4093-a357-79dd303872e9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46632024-12-21T06:19:49.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 505f2e0b-db6b-4e3d-91f9-55adbaba24e3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46642024-12-21T06:19:49.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 505f2e0b-db6b-4e3d-91f9-55adbaba24e3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46652024-12-21T06:19:49.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 505f2e0b-db6b-4e3d-91f9-55adbaba24e3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46662024-12-21T06:19:50.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
46672024-12-21T06:19:50.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46682024-12-21T06:19:50.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46692024-12-21T06:19:50.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
46702024-12-21T06:19:50.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46712024-12-21T06:19:50.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46722024-12-21T06:19:50.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46732024-12-21T06:19:50.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46742024-12-21T06:19:50.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46752024-12-21T06:19:50.382ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.491764ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46762024-12-21T06:19:50.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46772024-12-21T06:19:50.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46782024-12-21T06:19:50.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46792024-12-21T06:19:50.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46802024-12-21T06:19:50.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46812024-12-21T06:19:50.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46822024-12-21T06:19:50.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
46832024-12-21T06:19:50.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46842024-12-21T06:19:50.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46852024-12-21T06:19:50.401ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
46862024-12-21T06:19:50.401ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.271224ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
46872024-12-21T06:19:50.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 524e2956-0c84-4e11-9c20-e1beb3e896eb roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46882024-12-21T06:19:50.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 524e2956-0c84-4e11-9c20-e1beb3e896eb resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46892024-12-21T06:19:50.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 524e2956-0c84-4e11-9c20-e1beb3e896eb response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46902024-12-21T06:19:52.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b3eeadd6-047a-48a1-82ce-94c413f58609 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46912024-12-21T06:19:52.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b3eeadd6-047a-48a1-82ce-94c413f58609 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46922024-12-21T06:19:52.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b3eeadd6-047a-48a1-82ce-94c413f58609 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46932024-12-21T06:19:53.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4acc4fc5-8d22-4e12-bdb0-d49365ead021 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46942024-12-21T06:19:53.035ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4acc4fc5-8d22-4e12-bdb0-d49365ead021 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46952024-12-21T06:19:53.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4acc4fc5-8d22-4e12-bdb0-d49365ead021 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46962024-12-21T06:19:53.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1358 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 0d84a1dd-ae73-4994-981e-fd800ec1f7a4 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
46972024-12-21T06:19:54.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1cbb889a-2a8a-45d4-be87-d3416673efdb roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46982024-12-21T06:19:54.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1cbb889a-2a8a-45d4-be87-d3416673efdb resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
46992024-12-21T06:19:54.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1cbb889a-2a8a-45d4-be87-d3416673efdb response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47002024-12-21T06:19:55.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a64e6f0a-0301-49d2-a212-ccc180b30d62 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47012024-12-21T06:19:55.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a64e6f0a-0301-49d2-a212-ccc180b30d62 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47022024-12-21T06:19:55.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a64e6f0a-0301-49d2-a212-ccc180b30d62 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47032024-12-21T06:19:56.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2ba332c0-c176-4f37-a96f-ee19dbad35f1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47042024-12-21T06:19:56.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2ba332c0-c176-4f37-a96f-ee19dbad35f1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47052024-12-21T06:19:56.103ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2ba332c0-c176-4f37-a96f-ee19dbad35f1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47062024-12-21T06:19:57.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ac4d5436-e9de-4032-ba46-ad3d62d910e0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47072024-12-21T06:19:57.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ac4d5436-e9de-4032-ba46-ad3d62d910e0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47082024-12-21T06:19:57.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ac4d5436-e9de-4032-ba46-ad3d62d910e0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47092024-12-21T06:19:58.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 64227e9c-e1ac-4481-ba24-cf56316854f7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47102024-12-21T06:19:58.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 64227e9c-e1ac-4481-ba24-cf56316854f7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47112024-12-21T06:19:58.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 64227e9c-e1ac-4481-ba24-cf56316854f7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47122024-12-21T06:19:59.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 20aea730-101c-4704-9141-29820fdad3dd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47132024-12-21T06:19:59.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 20aea730-101c-4704-9141-29820fdad3dd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47142024-12-21T06:19:59.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 20aea730-101c-4704-9141-29820fdad3dd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47152024-12-21T06:20:00.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95ebd848-d473-4d31-800a-fe6f6ab4f362 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47162024-12-21T06:20:00.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95ebd848-d473-4d31-800a-fe6f6ab4f362 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47172024-12-21T06:20:00.187ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95ebd848-d473-4d31-800a-fe6f6ab4f362 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
47182024-12-21T06:20:00.350ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
47192024-12-21T06:20:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
47202024-12-21T06:20:00.350ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
47212024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
47222024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47232024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47242024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
47252024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
47262024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
47272024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
47282024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
47292024-12-21T06:20:00.351ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 7c419228-2431-4394-af83-ea0457364b70
47302024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.851\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"7c419228-2431-4394-af83-ea0457364b70"}
47312024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
47322024-12-21T06:20:00.351ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 06:10:00.351037298 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
47332024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
47342024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
47352024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
47362024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
47372024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
47382024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47392024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
47402024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47412024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
47422024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
47432024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
47442024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47452024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
47462024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
47472024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
47482024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
47492024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47502024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47512024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
47522024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
47532024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
47542024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47552024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
47562024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
47572024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47582024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
47592024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
47602024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47612024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47622024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
47632024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47642024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
47652024-12-21T06:20:00.351ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
47662024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
47672024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47682024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
47692024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
47702024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47712024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
47722024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
47732024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47742024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
47752024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47762024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47772024-12-21T06:20:00.351ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("068965c6-3480-4953-b57e-dd969abb2a21.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("45c0a855-5592-491c-b7b3-470902319db2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1331, tv_nsec: 436172074 } })
47782024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47792024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
47802024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47812024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
47822024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47832024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47842024-12-21T06:20:00.351ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1331, tv_nsec: 436293447 } })
47852024-12-21T06:20:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47862024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47872024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
47882024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
47892024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
47902024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
47912024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
47922024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47932024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
47942024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
47952024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.293045ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
47962024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.44367ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
47972024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
47982024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
47992024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
48002024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48012024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
48022024-12-21T06:20:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
48032024-12-21T06:20:00.354ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.503067ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
48042024-12-21T06:20:00.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1331, tv_nsec: 439201148 } })
48052024-12-21T06:20:00.355ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
48062024-12-21T06:20:00.355ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1331, tv_nsec: 439782114 } })
48072024-12-21T06:20:00.355ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 06:10:00.351037298 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
48082024-12-21T06:20:00.355ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.554847ms iteration = 7 status = {"expiration":"2024-12-21T06:10:00.351037298Z","pruned":[]}
48092024-12-21T06:20:00.355ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
48102024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
48112024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
48122024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
48132024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48142024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
48152024-12-21T06:20:00.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
48162024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48172024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
48182024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
48192024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
48202024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
48212024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
48222024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
48232024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
48242024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48252024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48262024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48272024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
48282024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48292024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48302024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
48312024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48322024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48332024-12-21T06:20:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
48342024-12-21T06:20:00.357ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48352024-12-21T06:20:00.359ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
48362024-12-21T06:20:00.359ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48372024-12-21T06:20:00.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48382024-12-21T06:20:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48392024-12-21T06:20:00.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48402024-12-21T06:20:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
48412024-12-21T06:20:00.360ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48422024-12-21T06:20:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48432024-12-21T06:20:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48442024-12-21T06:20:00.364ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48452024-12-21T06:20:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
48462024-12-21T06:20:00.367ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48472024-12-21T06:20:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48482024-12-21T06:20:00.367ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48492024-12-21T06:20:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
48502024-12-21T06:20:00.369ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48512024-12-21T06:20:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48522024-12-21T06:20:00.371ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48532024-12-21T06:20:00.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48542024-12-21T06:20:00.373ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
48552024-12-21T06:20:00.373ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48562024-12-21T06:20:00.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48572024-12-21T06:20:00.375ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
48582024-12-21T06:20:00.377ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.435485ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
48592024-12-21T06:20:00.403ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48602024-12-21T06:20:00.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48612024-12-21T06:20:00.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48622024-12-21T06:20:00.406ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48632024-12-21T06:20:00.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48642024-12-21T06:20:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48652024-12-21T06:20:00.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48662024-12-21T06:20:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48672024-12-21T06:20:00.410ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
48682024-12-21T06:20:00.410ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48692024-12-21T06:20:00.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
48702024-12-21T06:20:00.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48712024-12-21T06:20:00.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48722024-12-21T06:20:00.412ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48732024-12-21T06:20:00.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
48742024-12-21T06:20:00.413ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
48752024-12-21T06:20:00.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
48762024-12-21T06:20:00.414ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48772024-12-21T06:20:00.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48782024-12-21T06:20:00.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
48792024-12-21T06:20:00.415ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48802024-12-21T06:20:00.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48812024-12-21T06:20:00.416ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48822024-12-21T06:20:00.416ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48832024-12-21T06:20:00.416ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48842024-12-21T06:20:00.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48852024-12-21T06:20:00.417ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48862024-12-21T06:20:00.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48872024-12-21T06:20:00.417ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48882024-12-21T06:20:00.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48892024-12-21T06:20:00.418ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48902024-12-21T06:20:00.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48912024-12-21T06:20:00.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 62.613997ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
48922024-12-21T06:20:00.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
48932024-12-21T06:20:00.419ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
48942024-12-21T06:20:00.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
48952024-12-21T06:20:00.420ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48962024-12-21T06:20:00.420ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
48972024-12-21T06:20:00.420ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48982024-12-21T06:20:00.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48992024-12-21T06:20:00.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49002024-12-21T06:20:00.421ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49012024-12-21T06:20:00.422ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49022024-12-21T06:20:00.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49032024-12-21T06:20:00.422ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49042024-12-21T06:20:00.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49052024-12-21T06:20:00.423ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49062024-12-21T06:20:00.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49072024-12-21T06:20:00.423ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1331, tv_nsec: 508089898 } })
49082024-12-21T06:20:00.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49092024-12-21T06:20:00.423ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
49102024-12-21T06:20:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49112024-12-21T06:20:00.424ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49122024-12-21T06:20:00.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
49132024-12-21T06:20:00.425ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49142024-12-21T06:20:00.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49152024-12-21T06:20:00.426ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
49162024-12-21T06:20:00.426ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
49172024-12-21T06:20:00.426ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.778125ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
49182024-12-21T06:20:00.426ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
49192024-12-21T06:20:00.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49202024-12-21T06:20:00.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49212024-12-21T06:20:00.428ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
49222024-12-21T06:20:00.428ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
49232024-12-21T06:20:00.428ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
49242024-12-21T06:20:00.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49252024-12-21T06:20:00.428ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.941996ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
49262024-12-21T06:20:00.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49272024-12-21T06:20:00.429ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.112267ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49282024-12-21T06:20:00.429ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 78.493987ms iteration = 4 status = {"nsuccess":5}
49292024-12-21T06:20:00.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49302024-12-21T06:20:00.430ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49312024-12-21T06:20:00.431ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49322024-12-21T06:20:00.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49332024-12-21T06:20:00.432ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
49342024-12-21T06:20:00.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49352024-12-21T06:20:00.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49362024-12-21T06:20:00.432ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49372024-12-21T06:20:00.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49382024-12-21T06:20:00.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49392024-12-21T06:20:00.435ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49402024-12-21T06:20:00.439ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49412024-12-21T06:20:00.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49422024-12-21T06:20:00.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49432024-12-21T06:20:00.441ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49442024-12-21T06:20:00.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49452024-12-21T06:20:00.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.473674ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49462024-12-21T06:20:00.450ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49472024-12-21T06:20:00.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
49482024-12-21T06:20:00.451ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
49492024-12-21T06:20:00.451ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.525268ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
49502024-12-21T06:20:00.458ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49512024-12-21T06:20:00.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49522024-12-21T06:20:00.461ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49532024-12-21T06:20:00.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49542024-12-21T06:20:00.463ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49552024-12-21T06:20:00.464ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
49562024-12-21T06:20:00.464ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
49572024-12-21T06:20:00.464ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
49582024-12-21T06:20:00.464ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49592024-12-21T06:20:00.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49602024-12-21T06:20:00.465ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
49612024-12-21T06:20:00.465ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
49622024-12-21T06:20:00.465ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 114.170656ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
49632024-12-21T06:20:00.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
49642024-12-21T06:20:00.465ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49652024-12-21T06:20:00.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49662024-12-21T06:20:00.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49672024-12-21T06:20:00.466ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49682024-12-21T06:20:00.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49692024-12-21T06:20:00.467ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 116.362217ms iteration = 13 status = 0
49702024-12-21T06:20:00.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49712024-12-21T06:20:00.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49722024-12-21T06:20:00.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49732024-12-21T06:20:00.469ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49742024-12-21T06:20:00.469ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49752024-12-21T06:20:00.469ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49762024-12-21T06:20:00.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49772024-12-21T06:20:00.471ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
49782024-12-21T06:20:00.471ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
49792024-12-21T06:20:00.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49802024-12-21T06:20:00.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49812024-12-21T06:20:00.473ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49822024-12-21T06:20:00.473ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
49832024-12-21T06:20:00.473ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 0 version = 2
49842024-12-21T06:20:00.473ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49852024-12-21T06:20:00.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49862024-12-21T06:20:00.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
49872024-12-21T06:20:00.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49882024-12-21T06:20:00.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49892024-12-21T06:20:00.476ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49902024-12-21T06:20:00.478ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49912024-12-21T06:20:00.478ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 127.022493ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49922024-12-21T06:20:00.478ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
49932024-12-21T06:20:00.478ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
49942024-12-21T06:20:00.478ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 06:14:07.931887 UTC dns_group = internal generation = 1
49952024-12-21T06:20:00.478ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 127.743313ms iteration = 8 status = {"generation":1}
49962024-12-21T06:20:00.479ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 128.080702ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49972024-12-21T06:20:00.479ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 122.95732ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
49982024-12-21T06:20:00.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
49992024-12-21T06:20:00.479ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50002024-12-21T06:20:00.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50012024-12-21T06:20:00.480ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 1 version = 2
50022024-12-21T06:20:00.480ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
50032024-12-21T06:20:00.480ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 06:14:08.776888 UTC dns_group = external generation = 2
50042024-12-21T06:20:00.480ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 129.964594ms iteration = 8 status = {"generation":2}
50052024-12-21T06:20:00.496ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50062024-12-21T06:20:00.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50072024-12-21T06:20:00.500ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50082024-12-21T06:20:00.500ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50092024-12-21T06:20:00.500ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.155667ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50102024-12-21T06:20:00.506ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50112024-12-21T06:20:00.508ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50122024-12-21T06:20:00.508ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50132024-12-21T06:20:00.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50142024-12-21T06:20:00.541ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50152024-12-21T06:20:00.541ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50162024-12-21T06:20:00.542ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eccd6dca-28e2-444d-a237-00bd21dbd91d", "content-length": "26", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} })
50172024-12-21T06:20:00.542ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50182024-12-21T06:20:00.543ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50192024-12-21T06:20:00.543ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50202024-12-21T06:20:00.543ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "329c704a-0c3b-477f-b2a5-257e5157a782", "content-length": "26", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} })
50212024-12-21T06:20:00.543ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50222024-12-21T06:20:00.544ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50232024-12-21T06:20:00.545ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50242024-12-21T06:20:00.551ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 199.842952ms iteration = 16 status = {"physical_disks_added":0}
50252024-12-21T06:20:00.551ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T06:13:58.796551Z, time_modified: 2024-12-21T06:13:58.796551Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }) }
50262024-12-21T06:20:00.551ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 200.545222ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]}},"default_endpoint":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
50272024-12-21T06:20:00.559ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
50282024-12-21T06:20:00.559ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 208.561845ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
50292024-12-21T06:20:00.591ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
50302024-12-21T06:20:00.591ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50312024-12-21T06:20:00.591ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e00625e-8f7e-4066-86cd-aece1a4fc38c", "content-length": "26", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} })
50322024-12-21T06:20:00.591ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50332024-12-21T06:20:00.593ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
50342024-12-21T06:20:00.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50352024-12-21T06:20:00.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50362024-12-21T06:20:00.602ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50372024-12-21T06:20:00.604ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50382024-12-21T06:20:00.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50392024-12-21T06:20:00.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50402024-12-21T06:20:00.630ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
50412024-12-21T06:20:00.657ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
50422024-12-21T06:20:00.708ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50432024-12-21T06:20:00.708ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50442024-12-21T06:20:00.709ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "907de9c3-8138-40a2-8c00-df490db350bc", "content-length": "372", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} })
50452024-12-21T06:20:00.709ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50462024-12-21T06:20:00.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50472024-12-21T06:20:00.710ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50482024-12-21T06:20:00.712ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50492024-12-21T06:20:00.712ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50502024-12-21T06:20:00.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50512024-12-21T06:20:00.732ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50522024-12-21T06:20:00.733ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b48b255f-48c0-46a1-83d2-bb2262a93627", "content-length": "1", "date": "Sat, 21 Dec 2024 06:19:59 GMT"} })
50532024-12-21T06:20:00.734ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50542024-12-21T06:20:00.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50552024-12-21T06:20:00.736ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 385.344127ms iteration = 13 status = null
50562024-12-21T06:20:00.737ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 386.270603ms iteration = 13 status = {}
50572024-12-21T06:20:00.751ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
50582024-12-21T06:20:00.751ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
50592024-12-21T06:20:00.751ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "320ee51c-6d22-4473-8cdf-048939ca4246", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} })
50602024-12-21T06:20:00.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50612024-12-21T06:20:00.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50622024-12-21T06:20:00.862ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
50632024-12-21T06:20:00.862ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "697cb3ed-8f7d-4c02-a5f5-19d707765c94", "content-length": "691", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} })
50642024-12-21T06:20:00.862ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
50652024-12-21T06:20:00.862ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
50662024-12-21T06:20:00.862ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
50672024-12-21T06:20:00.864ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 512.979627ms iteration = 13 status = {}
50682024-12-21T06:20:00.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50692024-12-21T06:20:00.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50702024-12-21T06:20:00.867ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50712024-12-21T06:20:00.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50722024-12-21T06:20:00.870ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
50732024-12-21T06:20:00.870ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50742024-12-21T06:20:00.870ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9cd2638a-b8b7-4a33-b90b-37dfc1b92c7c", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} })
50752024-12-21T06:20:00.872ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 516.518466ms iteration = 14 status = {}
50762024-12-21T06:20:00.896ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
50772024-12-21T06:20:00.897ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ce6ace50-0890-4c05-ac46-fa50362fa739", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50782024-12-21T06:20:00.897ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50792024-12-21T06:20:00.898ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3178a65f-c8fd-4d2c-b222-fe34a0284261", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50802024-12-21T06:20:00.898ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50812024-12-21T06:20:00.900ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
50822024-12-21T06:20:00.900ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 549.112849ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
50832024-12-21T06:20:00.904ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
50842024-12-21T06:20:00.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50852024-12-21T06:20:00.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50862024-12-21T06:20:00.952ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
50872024-12-21T06:20:00.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50882024-12-21T06:20:00.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50892024-12-21T06:20:00.958ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
50902024-12-21T06:20:00.958ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "cf753030-26fc-44fb-84cb-c99067ccdda4", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
50912024-12-21T06:20:00.958ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
50922024-12-21T06:20:00.960ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6080256e-5c80-4e62-a244-1cfa424633f4", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
50932024-12-21T06:20:00.960ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
50942024-12-21T06:20:00.961ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "204dbb17-18ec-407d-973d-0797701165f5", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
50952024-12-21T06:20:00.961ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
50962024-12-21T06:20:00.962ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
50972024-12-21T06:20:00.963ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c06d62b2-fd26-4bbb-aaac-f9ca22586bb6", "content-length": "134", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} })
50982024-12-21T06:20:00.963ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
50992024-12-21T06:20:00.963ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
51002024-12-21T06:20:00.963ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
51012024-12-21T06:20:00.963ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 612.322692ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
51022024-12-21T06:20:00.963ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
51032024-12-21T06:20:00.963ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51042024-12-21T06:20:00.963ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51052024-12-21T06:20:00.963ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51062024-12-21T06:20:00.963ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51072024-12-21T06:20:00.963ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51082024-12-21T06:20:00.963ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51092024-12-21T06:20:00.963ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51102024-12-21T06:20:00.963ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
51112024-12-21T06:20:00.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51122024-12-21T06:20:00.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51132024-12-21T06:20:00.965ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51142024-12-21T06:20:00.965ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "452b2a7a-33be-47ab-a832-ac88d3fa4d79", "content-length": "2", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} })
51152024-12-21T06:20:00.965ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51162024-12-21T06:20:00.965ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6748bf2-799a-4d7d-abf7-ac5ca843c63b", "content-length": "52", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} })
51172024-12-21T06:20:00.965ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
51182024-12-21T06:20:00.965ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51192024-12-21T06:20:01.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = a3d6f682-8eaf-4e68-a255-87d132c80712 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51202024-12-21T06:20:01.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = a3d6f682-8eaf-4e68-a255-87d132c80712 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51212024-12-21T06:20:01.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2996 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = a3d6f682-8eaf-4e68-a255-87d132c80712 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51222024-12-21T06:20:01.060ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7496639e-14de-4d8d-b98b-054ba6f4cbb9", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} })
51232024-12-21T06:20:01.060ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
51242024-12-21T06:20:01.060ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51252024-12-21T06:20:01.060ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5741f0f1-1012-4ec0-a2d4-e18e374744ed", "content-length": "682", "date": "Sat, 21 Dec 2024 06:20:00 GMT"} })
51262024-12-21T06:20:01.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51272024-12-21T06:20:01.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51282024-12-21T06:20:01.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51292024-12-21T06:20:01.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51302024-12-21T06:20:01.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51312024-12-21T06:20:01.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51322024-12-21T06:20:01.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51332024-12-21T06:20:01.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51342024-12-21T06:20:01.078ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 727.307021ms iteration = 13 status = {}
51352024-12-21T06:20:01.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 666cfce5-f855-4a2a-9e8f-3b431ed36688 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51362024-12-21T06:20:01.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 666cfce5-f855-4a2a-9e8f-3b431ed36688 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51372024-12-21T06:20:01.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 666cfce5-f855-4a2a-9e8f-3b431ed36688 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51382024-12-21T06:20:02.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 760c3c07-8006-4908-97e3-1fd8c74ca696 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51392024-12-21T06:20:02.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 760c3c07-8006-4908-97e3-1fd8c74ca696 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51402024-12-21T06:20:02.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 760c3c07-8006-4908-97e3-1fd8c74ca696 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51412024-12-21T06:20:03.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1feae8a3-6d7e-4fb5-aa16-26fa4768d39a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51422024-12-21T06:20:03.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1feae8a3-6d7e-4fb5-aa16-26fa4768d39a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51432024-12-21T06:20:03.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2758 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1feae8a3-6d7e-4fb5-aa16-26fa4768d39a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51442024-12-21T06:20:03.970ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1543 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 33cbcc2d-f124-44ca-a4f2-cdf091d0d57a response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
51452024-12-21T06:20:04.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ad7c6d18-e41a-4970-9a2e-d9b514429248 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51462024-12-21T06:20:04.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ad7c6d18-e41a-4970-9a2e-d9b514429248 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51472024-12-21T06:20:04.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ad7c6d18-e41a-4970-9a2e-d9b514429248 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51482024-12-21T06:20:05.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4af4151d-068f-40ff-a8f8-95255445e89e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51492024-12-21T06:20:05.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4af4151d-068f-40ff-a8f8-95255445e89e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51502024-12-21T06:20:05.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4af4151d-068f-40ff-a8f8-95255445e89e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51512024-12-21T06:20:06.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 787a1d81-af81-4177-8857-7558b1604bae roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51522024-12-21T06:20:06.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 787a1d81-af81-4177-8857-7558b1604bae resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51532024-12-21T06:20:06.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 787a1d81-af81-4177-8857-7558b1604bae response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51542024-12-21T06:20:07.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c17efd3b-b67b-4eab-b552-765da827dc8a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51552024-12-21T06:20:07.336ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c17efd3b-b67b-4eab-b552-765da827dc8a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51562024-12-21T06:20:07.338ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c17efd3b-b67b-4eab-b552-765da827dc8a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51572024-12-21T06:20:08.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 51dcc2c3-0dff-474f-9747-005014438cc9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51582024-12-21T06:20:08.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 51dcc2c3-0dff-474f-9747-005014438cc9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51592024-12-21T06:20:08.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1938 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 51dcc2c3-0dff-474f-9747-005014438cc9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51602024-12-21T06:20:09.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e16f5ef-05d1-43d1-a37f-0773aaddd0f4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51612024-12-21T06:20:09.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e16f5ef-05d1-43d1-a37f-0773aaddd0f4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51622024-12-21T06:20:09.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2244 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e16f5ef-05d1-43d1-a37f-0773aaddd0f4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51632024-12-21T06:20:10.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
51642024-12-21T06:20:10.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51652024-12-21T06:20:10.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51662024-12-21T06:20:10.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
51672024-12-21T06:20:10.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51682024-12-21T06:20:10.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51692024-12-21T06:20:10.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51702024-12-21T06:20:10.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51712024-12-21T06:20:10.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51722024-12-21T06:20:10.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51732024-12-21T06:20:10.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51742024-12-21T06:20:10.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51752024-12-21T06:20:10.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51762024-12-21T06:20:10.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
51772024-12-21T06:20:10.362ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51782024-12-21T06:20:10.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51792024-12-21T06:20:10.377ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
51802024-12-21T06:20:10.377ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.253478ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
51812024-12-21T06:20:10.384ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51822024-12-21T06:20:10.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51832024-12-21T06:20:10.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 657dc047-1a95-4f2e-854c-3d91c4b53f06 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51842024-12-21T06:20:10.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 657dc047-1a95-4f2e-854c-3d91c4b53f06 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51852024-12-21T06:20:10.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 657dc047-1a95-4f2e-854c-3d91c4b53f06 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51862024-12-21T06:20:10.413ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.63968ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51872024-12-21T06:20:11.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8d64508c-eb88-4e98-957c-5750da4a9bd9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51882024-12-21T06:20:11.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8d64508c-eb88-4e98-957c-5750da4a9bd9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51892024-12-21T06:20:11.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8d64508c-eb88-4e98-957c-5750da4a9bd9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51902024-12-21T06:20:12.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3cb8e4b1-31d1-4cdb-bf68-5461f8cb09d7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51912024-12-21T06:20:12.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3cb8e4b1-31d1-4cdb-bf68-5461f8cb09d7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51922024-12-21T06:20:12.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3cb8e4b1-31d1-4cdb-bf68-5461f8cb09d7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51932024-12-21T06:20:13.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13dc21be-983d-43cc-a233-2c467dccedfe roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51942024-12-21T06:20:13.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13dc21be-983d-43cc-a233-2c467dccedfe resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51952024-12-21T06:20:13.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13dc21be-983d-43cc-a233-2c467dccedfe response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51962024-12-21T06:20:13.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1384 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 2e496b53-3f32-47ba-b36b-d19876842354 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
51972024-12-21T06:20:14.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9282fd5e-cdb0-4f34-b19b-24b433500388 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51982024-12-21T06:20:14.485ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9282fd5e-cdb0-4f34-b19b-24b433500388 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
51992024-12-21T06:20:14.486ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9282fd5e-cdb0-4f34-b19b-24b433500388 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52002024-12-21T06:20:15.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 91be8761-8d99-4c4e-9b38-8890a7efc2ef roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52012024-12-21T06:20:15.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 91be8761-8d99-4c4e-9b38-8890a7efc2ef resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52022024-12-21T06:20:15.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 91be8761-8d99-4c4e-9b38-8890a7efc2ef response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52032024-12-21T06:20:16.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b2793994-bbf4-405c-9beb-30600d10808c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52042024-12-21T06:20:16.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b2793994-bbf4-405c-9beb-30600d10808c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52052024-12-21T06:20:16.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b2793994-bbf4-405c-9beb-30600d10808c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52062024-12-21T06:20:17.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 585d8857-3912-45ff-8a55-afc9dcc4ea9a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52072024-12-21T06:20:17.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 585d8857-3912-45ff-8a55-afc9dcc4ea9a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52082024-12-21T06:20:17.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2514 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 585d8857-3912-45ff-8a55-afc9dcc4ea9a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52092024-12-21T06:20:18.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8edbf2c5-be61-41cb-bf03-9d147068dd2f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52102024-12-21T06:20:18.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8edbf2c5-be61-41cb-bf03-9d147068dd2f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52112024-12-21T06:20:18.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8edbf2c5-be61-41cb-bf03-9d147068dd2f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52122024-12-21T06:20:19.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6a96160a-e7a1-4ccb-9a51-395f19067993 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52132024-12-21T06:20:19.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6a96160a-e7a1-4ccb-9a51-395f19067993 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52142024-12-21T06:20:19.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1610 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6a96160a-e7a1-4ccb-9a51-395f19067993 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52152024-12-21T06:20:20.351ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
52162024-12-21T06:20:20.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
52172024-12-21T06:20:20.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52182024-12-21T06:20:20.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52192024-12-21T06:20:20.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52202024-12-21T06:20:20.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52212024-12-21T06:20:20.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52222024-12-21T06:20:20.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52232024-12-21T06:20:20.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52242024-12-21T06:20:20.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52252024-12-21T06:20:20.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52262024-12-21T06:20:20.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52272024-12-21T06:20:20.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52282024-12-21T06:20:20.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
52292024-12-21T06:20:20.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52302024-12-21T06:20:20.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52312024-12-21T06:20:20.371ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
52322024-12-21T06:20:20.371ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.824598ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
52332024-12-21T06:20:20.380ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52342024-12-21T06:20:20.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52352024-12-21T06:20:20.382ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.266017ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52362024-12-21T06:20:20.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 90563c21-bb38-4cb7-b48d-247462d506bd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52372024-12-21T06:20:20.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 90563c21-bb38-4cb7-b48d-247462d506bd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52382024-12-21T06:20:20.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 90563c21-bb38-4cb7-b48d-247462d506bd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52392024-12-21T06:20:21.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6014d2f9-15dc-4a27-b4c3-5b82b1d36b9d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52402024-12-21T06:20:21.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6014d2f9-15dc-4a27-b4c3-5b82b1d36b9d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52412024-12-21T06:20:21.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6014d2f9-15dc-4a27-b4c3-5b82b1d36b9d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52422024-12-21T06:20:22.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a0fe3f20-beb4-4a8e-9110-91e31109eb5e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52432024-12-21T06:20:22.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a0fe3f20-beb4-4a8e-9110-91e31109eb5e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52442024-12-21T06:20:22.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a0fe3f20-beb4-4a8e-9110-91e31109eb5e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52452024-12-21T06:20:23.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 500bf76e-28a2-41a2-bbd8-d867990d7e6b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52462024-12-21T06:20:23.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 500bf76e-28a2-41a2-bbd8-d867990d7e6b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52472024-12-21T06:20:23.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 500bf76e-28a2-41a2-bbd8-d867990d7e6b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52482024-12-21T06:20:23.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1196 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 2a66e399-18f2-4552-ab27-dea07052a697 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
52492024-12-21T06:20:24.702ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e9b3177d-6c80-4686-b72b-b315a0bfa68b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52502024-12-21T06:20:24.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e9b3177d-6c80-4686-b72b-b315a0bfa68b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52512024-12-21T06:20:24.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e9b3177d-6c80-4686-b72b-b315a0bfa68b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52522024-12-21T06:20:25.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b31df4b9-f2f0-44f1-a3a1-866859473fd3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52532024-12-21T06:20:25.724ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b31df4b9-f2f0-44f1-a3a1-866859473fd3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52542024-12-21T06:20:25.726ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b31df4b9-f2f0-44f1-a3a1-866859473fd3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52552024-12-21T06:20:26.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 96fe7af6-7845-4299-9d15-9329a655589a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52562024-12-21T06:20:26.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 96fe7af6-7845-4299-9d15-9329a655589a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52572024-12-21T06:20:26.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 96fe7af6-7845-4299-9d15-9329a655589a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52582024-12-21T06:20:27.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c721e519-5777-4d3a-9a1f-bfaec7389321 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52592024-12-21T06:20:27.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c721e519-5777-4d3a-9a1f-bfaec7389321 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52602024-12-21T06:20:27.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c721e519-5777-4d3a-9a1f-bfaec7389321 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52612024-12-21T06:20:28.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e7f85cc4-8cc5-445e-98f0-60cc11f7214a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52622024-12-21T06:20:28.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e7f85cc4-8cc5-445e-98f0-60cc11f7214a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52632024-12-21T06:20:28.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1802 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e7f85cc4-8cc5-445e-98f0-60cc11f7214a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52642024-12-21T06:20:28.942ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:41441
52652024-12-21T06:20:28.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 382dc899-1f74-4359-82c1-34e92b89ab0c roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
52662024-12-21T06:20:28.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 382dc899-1f74-4359-82c1-34e92b89ab0c resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
52672024-12-21T06:20:28.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 382dc899-1f74-4359-82c1-34e92b89ab0c response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
52682024-12-21T06:20:28.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 60f96e12-f885-42b9-8072-f4b9a846b914 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
52692024-12-21T06:20:28.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 60f96e12-f885-42b9-8072-f4b9a846b914 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
52702024-12-21T06:20:28.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2252 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 60f96e12-f885-42b9-8072-f4b9a846b914 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
52712024-12-21T06:20:29.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 17f5111b-5517-4f07-a973-07457a009c32 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52722024-12-21T06:20:29.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 17f5111b-5517-4f07-a973-07457a009c32 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52732024-12-21T06:20:29.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 17f5111b-5517-4f07-a973-07457a009c32 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
52742024-12-21T06:20:30.350ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
52752024-12-21T06:20:30.350ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52762024-12-21T06:20:30.350ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
52772024-12-21T06:20:30.350ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52782024-12-21T06:20:30.350ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
52792024-12-21T06:20:30.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
52802024-12-21T06:20:30.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52812024-12-21T06:20:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52822024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52832024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52842024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
52852024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
52862024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52872024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52882024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
52892024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
52902024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52912024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52922024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52932024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
52942024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52952024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
52962024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52972024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
52982024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
52992024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53002024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53012024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53022024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53032024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53042024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53052024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53062024-12-21T06:20:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53072024-12-21T06:20:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53082024-12-21T06:20:30.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53092024-12-21T06:20:30.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1361, tv_nsec: 438199820 } })
53102024-12-21T06:20:30.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
53112024-12-21T06:20:30.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1361, tv_nsec: 438816927 } })
53122024-12-21T06:20:30.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
53132024-12-21T06:20:30.354ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.497604ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53142024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
53152024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
53162024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53172024-12-21T06:20:30.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53182024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
53192024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53202024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
53212024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53222024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53232024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
53242024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53252024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53262024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53272024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53282024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53292024-12-21T06:20:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53302024-12-21T06:20:30.357ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53312024-12-21T06:20:30.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53322024-12-21T06:20:30.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53332024-12-21T06:20:30.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53342024-12-21T06:20:30.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53352024-12-21T06:20:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53362024-12-21T06:20:30.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53372024-12-21T06:20:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53382024-12-21T06:20:30.362ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53392024-12-21T06:20:30.363ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1361, tv_nsec: 448426604 } })
53402024-12-21T06:20:30.364ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53412024-12-21T06:20:30.364ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53422024-12-21T06:20:30.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53432024-12-21T06:20:30.364ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
53442024-12-21T06:20:30.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53452024-12-21T06:20:30.368ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53462024-12-21T06:20:30.368ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53472024-12-21T06:20:30.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53482024-12-21T06:20:30.384ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53492024-12-21T06:20:30.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53502024-12-21T06:20:30.387ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53512024-12-21T06:20:30.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53522024-12-21T06:20:30.394ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53532024-12-21T06:20:30.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53542024-12-21T06:20:30.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53552024-12-21T06:20:30.396ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53562024-12-21T06:20:30.396ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53572024-12-21T06:20:30.396ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53582024-12-21T06:20:30.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53592024-12-21T06:20:30.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53602024-12-21T06:20:30.397ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53612024-12-21T06:20:30.397ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53622024-12-21T06:20:30.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53632024-12-21T06:20:30.398ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53642024-12-21T06:20:30.398ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.611442ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
53652024-12-21T06:20:30.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53662024-12-21T06:20:30.399ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.485566ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
53672024-12-21T06:20:30.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53682024-12-21T06:20:30.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53692024-12-21T06:20:30.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53702024-12-21T06:20:30.401ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53712024-12-21T06:20:30.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53722024-12-21T06:20:30.402ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53732024-12-21T06:20:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53742024-12-21T06:20:30.402ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
53752024-12-21T06:20:30.402ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 50.935772ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
53762024-12-21T06:20:30.449ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53772024-12-21T06:20:30.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53782024-12-21T06:20:30.452ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
53792024-12-21T06:20:30.452ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53802024-12-21T06:20:30.452ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6c80e9a-9daa-4332-9de7-6b2ebc96d0b2", "content-length": "26", "date": "Sat, 21 Dec 2024 06:20:30 GMT"} })
53812024-12-21T06:20:30.452ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53822024-12-21T06:20:30.454ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
53832024-12-21T06:20:30.468ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53842024-12-21T06:20:30.468ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53852024-12-21T06:20:30.469ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "29ce2a6f-9931-4a5b-966a-534d52a1e206", "content-length": "372", "date": "Sat, 21 Dec 2024 06:20:30 GMT"} })
53862024-12-21T06:20:30.469ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53872024-12-21T06:20:30.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53882024-12-21T06:20:30.471ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
53892024-12-21T06:20:30.471ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53902024-12-21T06:20:30.471ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a08de3b4-9596-4323-92c8-328fd943bb9f", "content-length": "26", "date": "Sat, 21 Dec 2024 06:20:30 GMT"} })
53912024-12-21T06:20:30.471ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53922024-12-21T06:20:30.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53932024-12-21T06:20:30.472ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53942024-12-21T06:20:30.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53952024-12-21T06:20:30.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53962024-12-21T06:20:30.473ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53972024-12-21T06:20:30.475ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53982024-12-21T06:20:30.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53992024-12-21T06:20:30.476ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
54002024-12-21T06:20:30.476ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54012024-12-21T06:20:30.477ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de35cbdb-9474-4afd-98b1-6d56ad01c653", "content-length": "26", "date": "Sat, 21 Dec 2024 06:20:30 GMT"} })
54022024-12-21T06:20:30.477ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54032024-12-21T06:20:30.480ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54042024-12-21T06:20:30.505ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54052024-12-21T06:20:30.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54062024-12-21T06:20:30.507ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 155.602466ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54072024-12-21T06:20:30.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54082024-12-21T06:20:30.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54092024-12-21T06:20:30.508ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 152.12712ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54102024-12-21T06:20:30.510ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54112024-12-21T06:20:30.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54122024-12-21T06:20:30.512ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54132024-12-21T06:20:30.512ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54142024-12-21T06:20:30.512ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54152024-12-21T06:20:30.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54162024-12-21T06:20:30.515ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54172024-12-21T06:20:30.516ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54182024-12-21T06:20:30.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54192024-12-21T06:20:30.517ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54202024-12-21T06:20:30.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54212024-12-21T06:20:30.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
54222024-12-21T06:20:30.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54232024-12-21T06:20:30.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54242024-12-21T06:20:30.519ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 167.805404ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54252024-12-21T06:20:30.531ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
54262024-12-21T06:20:30.531ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
54272024-12-21T06:20:30.531ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
54282024-12-21T06:20:30.531ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 181.239397ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
54292024-12-21T06:20:30.531ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0bae8dc2-fb9c-4701-88bb-0c54341b52bf", "date": "Sat, 21 Dec 2024 06:20:30 GMT"} })
54302024-12-21T06:20:30.531ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54312024-12-21T06:20:30.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54322024-12-21T06:20:30.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54332024-12-21T06:20:30.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54342024-12-21T06:20:30.536ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54352024-12-21T06:20:30.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54362024-12-21T06:20:30.540ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
54372024-12-21T06:20:30.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54382024-12-21T06:20:30.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54392024-12-21T06:20:30.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54402024-12-21T06:20:30.542ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 190.690139ms iteration = 14 status = 0
54412024-12-21T06:20:30.545ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 189.842185ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
54422024-12-21T06:20:30.547ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54432024-12-21T06:20:30.547ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54442024-12-21T06:20:30.547ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4c5de5d8-cd67-42fc-9d38-a6d7bc6ea338", "date": "Sat, 21 Dec 2024 06:20:30 GMT"} })
54452024-12-21T06:20:30.548ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 192.88087ms iteration = 15 status = {}
54462024-12-21T06:20:30.549ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54472024-12-21T06:20:30.549ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54482024-12-21T06:20:30.549ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 198.373592ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
54492024-12-21T06:20:30.570ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 219.647642ms iteration = 14 status = {}
54502024-12-21T06:20:30.577ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
54512024-12-21T06:20:30.577ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c28936b0-c5f9-4fd1-9802-05e38cd8813c", "content-length": "1", "date": "Sat, 21 Dec 2024 06:20:30 GMT"} })
54522024-12-21T06:20:30.578ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54532024-12-21T06:20:30.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54542024-12-21T06:20:30.581ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 230.944815ms iteration = 14 status = null
54552024-12-21T06:20:30.590ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54562024-12-21T06:20:30.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54572024-12-21T06:20:30.592ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54582024-12-21T06:20:30.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54592024-12-21T06:20:30.593ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54602024-12-21T06:20:30.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54612024-12-21T06:20:30.595ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54622024-12-21T06:20:30.597ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54632024-12-21T06:20:30.597ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54642024-12-21T06:20:30.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54652024-12-21T06:20:30.605ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 254.094997ms iteration = 17 status = {"physical_disks_added":0}
54662024-12-21T06:20:30.630ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54672024-12-21T06:20:30.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54682024-12-21T06:20:30.632ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
54692024-12-21T06:20:30.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54702024-12-21T06:20:30.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54712024-12-21T06:20:30.640ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54722024-12-21T06:20:30.641ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1808ed9-cbd8-48f6-a253-0ec3f5b5c08e", "content-length": "134", "date": "Sat, 21 Dec 2024 06:20:30 GMT"} })
54732024-12-21T06:20:30.641ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
54742024-12-21T06:20:30.641ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
54752024-12-21T06:20:30.641ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
54762024-12-21T06:20:30.641ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54772024-12-21T06:20:30.641ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54782024-12-21T06:20:30.641ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54792024-12-21T06:20:30.641ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54802024-12-21T06:20:30.641ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54812024-12-21T06:20:30.641ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54822024-12-21T06:20:30.641ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54832024-12-21T06:20:30.641ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
54842024-12-21T06:20:30.641ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54852024-12-21T06:20:30.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54862024-12-21T06:20:30.651ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54872024-12-21T06:20:30.652ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4edff796-92a0-427f-b56f-d5ee0cf32c94", "content-length": "2", "date": "Sat, 21 Dec 2024 06:20:30 GMT"} })
54882024-12-21T06:20:30.652ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54892024-12-21T06:20:30.652ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b4429e1-1b9e-41c1-99a6-b4499c501b71", "content-length": "52", "date": "Sat, 21 Dec 2024 06:20:30 GMT"} })
54902024-12-21T06:20:30.652ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
54912024-12-21T06:20:30.652ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54922024-12-21T06:20:30.684ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
54932024-12-21T06:20:30.742ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c6eb7b82-8538-4ad7-99db-c28269401f5d", "date": "Sat, 21 Dec 2024 06:20:30 GMT"} })
54942024-12-21T06:20:30.742ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
54952024-12-21T06:20:30.742ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54962024-12-21T06:20:30.743ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "36ca8f0f-4b44-4a55-a41c-16582f241c99", "content-length": "691", "date": "Sat, 21 Dec 2024 06:20:30 GMT"} })
54972024-12-21T06:20:30.743ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
54982024-12-21T06:20:30.743ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
54992024-12-21T06:20:30.743ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
55002024-12-21T06:20:30.743ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "da9b17b6-768b-4a64-bace-0c7916a27f22", "content-length": "682", "date": "Sat, 21 Dec 2024 06:20:30 GMT"} })
55012024-12-21T06:20:30.743ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55022024-12-21T06:20:30.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55032024-12-21T06:20:30.745ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 393.776121ms iteration = 14 status = {}
55042024-12-21T06:20:30.746ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55052024-12-21T06:20:30.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55062024-12-21T06:20:30.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55072024-12-21T06:20:30.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55082024-12-21T06:20:30.752ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55092024-12-21T06:20:30.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55102024-12-21T06:20:30.760ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 409.136287ms iteration = 14 status = {}
55112024-12-21T06:20:30.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ecb14aee-3424-4463-b820-a44692d35466 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55122024-12-21T06:20:30.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ecb14aee-3424-4463-b820-a44692d35466 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55132024-12-21T06:20:30.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ecb14aee-3424-4463-b820-a44692d35466 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55142024-12-21T06:20:31.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = aa29365a-8758-4b1b-bb2f-2c15d8b1968b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
55152024-12-21T06:20:31.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = aa29365a-8758-4b1b-bb2f-2c15d8b1968b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
55162024-12-21T06:20:31.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2581 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = aa29365a-8758-4b1b-bb2f-2c15d8b1968b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
55172024-12-21T06:20:31.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 25d38903-43e5-4617-937c-6554be1fe888 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55182024-12-21T06:20:31.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 25d38903-43e5-4617-937c-6554be1fe888 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55192024-12-21T06:20:31.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 25d38903-43e5-4617-937c-6554be1fe888 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55202024-12-21T06:20:32.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 545f76fc-11ab-4e58-bb4a-b38b61487403 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55212024-12-21T06:20:32.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 545f76fc-11ab-4e58-bb4a-b38b61487403 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55222024-12-21T06:20:32.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 545f76fc-11ab-4e58-bb4a-b38b61487403 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55232024-12-21T06:20:33.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 72dd4ac7-964d-49f7-b19d-a06618e108c2 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55242024-12-21T06:20:33.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 72dd4ac7-964d-49f7-b19d-a06618e108c2 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55252024-12-21T06:20:33.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 72dd4ac7-964d-49f7-b19d-a06618e108c2 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55262024-12-21T06:20:33.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1287 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 9edd116f-802a-46a1-93ff-aa159203798f response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
55272024-12-21T06:20:34.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fec3b348-5230-4712-8e59-02c85e26a7fd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55282024-12-21T06:20:34.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fec3b348-5230-4712-8e59-02c85e26a7fd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55292024-12-21T06:20:34.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2092 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fec3b348-5230-4712-8e59-02c85e26a7fd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55302024-12-21T06:20:35.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f725590c-3a26-4c91-9675-61d11ce9c437 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55312024-12-21T06:20:35.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f725590c-3a26-4c91-9675-61d11ce9c437 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55322024-12-21T06:20:35.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2438 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f725590c-3a26-4c91-9675-61d11ce9c437 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55332024-12-21T06:20:36.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7b8db477-e9f1-40ad-8b9d-64af09dd50a1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55342024-12-21T06:20:36.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7b8db477-e9f1-40ad-8b9d-64af09dd50a1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55352024-12-21T06:20:36.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1630 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7b8db477-e9f1-40ad-8b9d-64af09dd50a1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55362024-12-21T06:20:37.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8a7f11b7-d973-4eb5-87b1-126062a98e74 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55372024-12-21T06:20:37.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8a7f11b7-d973-4eb5-87b1-126062a98e74 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55382024-12-21T06:20:37.984ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1878 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8a7f11b7-d973-4eb5-87b1-126062a98e74 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55392024-12-21T06:20:39.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7cce4dd2-0c68-4a2c-9295-735fb6c1a54f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55402024-12-21T06:20:39.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7cce4dd2-0c68-4a2c-9295-735fb6c1a54f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55412024-12-21T06:20:39.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7cce4dd2-0c68-4a2c-9295-735fb6c1a54f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55422024-12-21T06:20:40.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 30a87e25-de9f-4ca3-a73f-a94654158c8a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55432024-12-21T06:20:40.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 30a87e25-de9f-4ca3-a73f-a94654158c8a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55442024-12-21T06:20:40.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 30a87e25-de9f-4ca3-a73f-a94654158c8a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55452024-12-21T06:20:40.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
55462024-12-21T06:20:40.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55472024-12-21T06:20:40.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55482024-12-21T06:20:40.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
55492024-12-21T06:20:40.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55502024-12-21T06:20:40.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55512024-12-21T06:20:40.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55522024-12-21T06:20:40.381ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55532024-12-21T06:20:40.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55542024-12-21T06:20:40.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55552024-12-21T06:20:40.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55562024-12-21T06:20:40.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55572024-12-21T06:20:40.382ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.923538ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55582024-12-21T06:20:40.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55592024-12-21T06:20:40.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55602024-12-21T06:20:40.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55612024-12-21T06:20:40.387ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
55622024-12-21T06:20:40.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55632024-12-21T06:20:40.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55642024-12-21T06:20:40.398ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
55652024-12-21T06:20:40.398ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.438203ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
55662024-12-21T06:20:41.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5ec01470-d0e3-492a-adca-8d4d574df2a7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55672024-12-21T06:20:41.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5ec01470-d0e3-492a-adca-8d4d574df2a7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55682024-12-21T06:20:41.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5ec01470-d0e3-492a-adca-8d4d574df2a7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55692024-12-21T06:20:42.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3f21f5a4-de10-4ca0-99dc-0e17c61a3f74 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55702024-12-21T06:20:42.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3f21f5a4-de10-4ca0-99dc-0e17c61a3f74 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55712024-12-21T06:20:42.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3f21f5a4-de10-4ca0-99dc-0e17c61a3f74 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55722024-12-21T06:20:43.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f9caa390-f200-4137-9a93-8a47991ae801 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55732024-12-21T06:20:43.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f9caa390-f200-4137-9a93-8a47991ae801 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55742024-12-21T06:20:43.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f9caa390-f200-4137-9a93-8a47991ae801 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55752024-12-21T06:20:43.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1667 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 8b5bc899-2f71-47de-bd03-3dced8c39e36 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
55762024-12-21T06:20:44.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5fd13851-55ee-45d8-a442-08b4342955ad roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55772024-12-21T06:20:44.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5fd13851-55ee-45d8-a442-08b4342955ad resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55782024-12-21T06:20:44.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5fd13851-55ee-45d8-a442-08b4342955ad response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55792024-12-21T06:20:45.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ffe56c84-b2f1-4c48-a9b4-e792ea62a448 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55802024-12-21T06:20:45.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ffe56c84-b2f1-4c48-a9b4-e792ea62a448 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55812024-12-21T06:20:45.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2255 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ffe56c84-b2f1-4c48-a9b4-e792ea62a448 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55822024-12-21T06:20:46.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 271ee215-d454-4d1d-91a5-fdf90a084530 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55832024-12-21T06:20:46.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 271ee215-d454-4d1d-91a5-fdf90a084530 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55842024-12-21T06:20:46.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 271ee215-d454-4d1d-91a5-fdf90a084530 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55852024-12-21T06:20:47.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7e1aad5a-5d8a-494d-9363-520d5e3f56a4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55862024-12-21T06:20:47.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7e1aad5a-5d8a-494d-9363-520d5e3f56a4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55872024-12-21T06:20:47.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1765 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7e1aad5a-5d8a-494d-9363-520d5e3f56a4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55882024-12-21T06:20:48.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7400e9a-37c6-4fa6-95cd-5ee88d2d2571 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55892024-12-21T06:20:48.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7400e9a-37c6-4fa6-95cd-5ee88d2d2571 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55902024-12-21T06:20:48.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2641 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7400e9a-37c6-4fa6-95cd-5ee88d2d2571 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55912024-12-21T06:20:49.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d87c8d78-9272-401c-b3ba-8eeb75ef801a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55922024-12-21T06:20:49.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d87c8d78-9272-401c-b3ba-8eeb75ef801a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55932024-12-21T06:20:49.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d87c8d78-9272-401c-b3ba-8eeb75ef801a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55942024-12-21T06:20:50.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 77ecf374-d175-4562-818c-27e092f633eb roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55952024-12-21T06:20:50.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 77ecf374-d175-4562-818c-27e092f633eb resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55962024-12-21T06:20:50.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 77ecf374-d175-4562-818c-27e092f633eb response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
55972024-12-21T06:20:50.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
55982024-12-21T06:20:50.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55992024-12-21T06:20:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56002024-12-21T06:20:50.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
56012024-12-21T06:20:50.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56022024-12-21T06:20:50.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56032024-12-21T06:20:50.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56042024-12-21T06:20:50.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56052024-12-21T06:20:50.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56062024-12-21T06:20:50.381ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.358622ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56072024-12-21T06:20:50.383ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56082024-12-21T06:20:50.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56092024-12-21T06:20:50.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56102024-12-21T06:20:50.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56112024-12-21T06:20:50.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56122024-12-21T06:20:50.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56132024-12-21T06:20:50.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
56142024-12-21T06:20:50.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56152024-12-21T06:20:50.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56162024-12-21T06:20:50.397ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
56172024-12-21T06:20:50.397ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.338733ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
56182024-12-21T06:20:51.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5c26a32d-f7cf-4f74-9147-3cdbcbd665b6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56192024-12-21T06:20:51.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5c26a32d-f7cf-4f74-9147-3cdbcbd665b6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56202024-12-21T06:20:51.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1683 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5c26a32d-f7cf-4f74-9147-3cdbcbd665b6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56212024-12-21T06:20:52.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b775b4e5-f613-4c6d-b3ac-267c9cb67766 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56222024-12-21T06:20:52.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b775b4e5-f613-4c6d-b3ac-267c9cb67766 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56232024-12-21T06:20:52.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2679 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b775b4e5-f613-4c6d-b3ac-267c9cb67766 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56242024-12-21T06:20:53.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d56afbd3-606b-441a-a2d8-35dc7f9aec62 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56252024-12-21T06:20:53.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d56afbd3-606b-441a-a2d8-35dc7f9aec62 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56262024-12-21T06:20:53.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d56afbd3-606b-441a-a2d8-35dc7f9aec62 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56272024-12-21T06:20:53.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1718 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 89745e05-400b-4182-ac83-72784d667936 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
56282024-12-21T06:20:54.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7b2cc8b-024c-4306-804b-a3e7cb5c41c9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56292024-12-21T06:20:54.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7b2cc8b-024c-4306-804b-a3e7cb5c41c9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56302024-12-21T06:20:54.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7b2cc8b-024c-4306-804b-a3e7cb5c41c9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56312024-12-21T06:20:55.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a8da842a-d0e9-49cb-96fb-4ba5af769e55 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56322024-12-21T06:20:55.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a8da842a-d0e9-49cb-96fb-4ba5af769e55 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56332024-12-21T06:20:55.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a8da842a-d0e9-49cb-96fb-4ba5af769e55 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56342024-12-21T06:20:56.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 34828757-3a1c-45e5-af75-ba8a97d54742 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56352024-12-21T06:20:56.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 34828757-3a1c-45e5-af75-ba8a97d54742 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56362024-12-21T06:20:56.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 34828757-3a1c-45e5-af75-ba8a97d54742 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56372024-12-21T06:20:57.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a72e2db8-5b0f-4a9e-bd4e-baa07e395434 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56382024-12-21T06:20:57.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a72e2db8-5b0f-4a9e-bd4e-baa07e395434 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56392024-12-21T06:20:57.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a72e2db8-5b0f-4a9e-bd4e-baa07e395434 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56402024-12-21T06:20:58.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b45a1701-d9fe-4e58-8c30-f9ca1d2aa9b9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56412024-12-21T06:20:58.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b45a1701-d9fe-4e58-8c30-f9ca1d2aa9b9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56422024-12-21T06:20:58.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b45a1701-d9fe-4e58-8c30-f9ca1d2aa9b9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56432024-12-21T06:20:58.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = d23721d7-664d-40ac-b64d-8c3387f99bbe roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
56442024-12-21T06:20:58.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = d23721d7-664d-40ac-b64d-8c3387f99bbe resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
56452024-12-21T06:20:58.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = d23721d7-664d-40ac-b64d-8c3387f99bbe response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
56462024-12-21T06:20:58.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 2f29107f-8fd2-4053-8b98-2cab358742d8 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
56472024-12-21T06:20:58.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 2f29107f-8fd2-4053-8b98-2cab358742d8 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
56482024-12-21T06:20:58.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 2f29107f-8fd2-4053-8b98-2cab358742d8 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
56492024-12-21T06:20:59.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 81d653b3-87ed-4ff6-a34e-e344244810e7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56502024-12-21T06:20:59.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 81d653b3-87ed-4ff6-a34e-e344244810e7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56512024-12-21T06:20:59.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 81d653b3-87ed-4ff6-a34e-e344244810e7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
56522024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
56532024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
56542024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56552024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
56562024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
56572024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
56582024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
56592024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56602024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
56612024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
56622024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
56632024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
56642024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
56652024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
56662024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
56672024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
56682024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
56692024-12-21T06:21:00.350ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 7c419228-2431-4394-af83-ea0457364b70
56702024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.24\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"7c419228-2431-4394-af83-ea0457364b70"}
56712024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
56722024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
56732024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56742024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
56752024-12-21T06:21:00.350ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 06:11:00.350538931 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
56762024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
56772024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56782024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
56792024-12-21T06:21:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
56802024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
56812024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56822024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56832024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
56842024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
56852024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
56862024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56872024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56882024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
56892024-12-21T06:21:00.351ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
56902024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
56912024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
56922024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56932024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
56942024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56952024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
56962024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
56972024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
56982024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56992024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57002024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57012024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
57022024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
57032024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57042024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
57052024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57062024-12-21T06:21:00.351ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("068965c6-3480-4953-b57e-dd969abb2a21.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("45c0a855-5592-491c-b7b3-470902319db2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1391, tv_nsec: 436103972 } })
57072024-12-21T06:21:00.351ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1391, tv_nsec: 436103112 } })
57082024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57092024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57102024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57112024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
57122024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57132024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57142024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57152024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57162024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57172024-12-21T06:21:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57182024-12-21T06:21:00.352ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
57192024-12-21T06:21:00.352ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.610675ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
57202024-12-21T06:21:00.352ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
57212024-12-21T06:21:00.352ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.664276ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
57222024-12-21T06:21:00.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57232024-12-21T06:21:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57242024-12-21T06:21:00.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57252024-12-21T06:21:00.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57262024-12-21T06:21:00.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1391, tv_nsec: 438341574 } })
57272024-12-21T06:21:00.353ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.361843ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57282024-12-21T06:21:00.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
57292024-12-21T06:21:00.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57302024-12-21T06:21:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
57312024-12-21T06:21:00.355ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
57322024-12-21T06:21:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57332024-12-21T06:21:00.355ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
57342024-12-21T06:21:00.355ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
57352024-12-21T06:21:00.355ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
57362024-12-21T06:21:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
57372024-12-21T06:21:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57382024-12-21T06:21:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
57392024-12-21T06:21:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57402024-12-21T06:21:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
57412024-12-21T06:21:00.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57422024-12-21T06:21:00.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
57432024-12-21T06:21:00.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57442024-12-21T06:21:00.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57452024-12-21T06:21:00.356ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1391, tv_nsec: 440704100 } })
57462024-12-21T06:21:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
57472024-12-21T06:21:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
57482024-12-21T06:21:00.356ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
57492024-12-21T06:21:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57502024-12-21T06:21:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57512024-12-21T06:21:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57522024-12-21T06:21:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57532024-12-21T06:21:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
57542024-12-21T06:21:00.356ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 06:11:00.350538931 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
57552024-12-21T06:21:00.356ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.861683ms iteration = 8 status = {"expiration":"2024-12-21T06:11:00.350538931Z","pruned":[]}
57562024-12-21T06:21:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57572024-12-21T06:21:00.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57582024-12-21T06:21:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57592024-12-21T06:21:00.360ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57602024-12-21T06:21:00.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57612024-12-21T06:21:00.362ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57622024-12-21T06:21:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57632024-12-21T06:21:00.366ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.310805ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
57642024-12-21T06:21:00.397ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57652024-12-21T06:21:00.399ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57662024-12-21T06:21:00.400ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
57672024-12-21T06:21:00.400ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57682024-12-21T06:21:00.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57692024-12-21T06:21:00.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
57702024-12-21T06:21:00.401ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57712024-12-21T06:21:00.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57722024-12-21T06:21:00.402ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57732024-12-21T06:21:00.402ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57742024-12-21T06:21:00.402ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57752024-12-21T06:21:00.402ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57762024-12-21T06:21:00.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57772024-12-21T06:21:00.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57782024-12-21T06:21:00.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57792024-12-21T06:21:00.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57802024-12-21T06:21:00.404ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57812024-12-21T06:21:00.404ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57822024-12-21T06:21:00.404ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57832024-12-21T06:21:00.404ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57842024-12-21T06:21:00.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57852024-12-21T06:21:00.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57862024-12-21T06:21:00.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57872024-12-21T06:21:00.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57882024-12-21T06:21:00.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57892024-12-21T06:21:00.406ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57902024-12-21T06:21:00.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57912024-12-21T06:21:00.407ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57922024-12-21T06:21:00.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57932024-12-21T06:21:00.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57942024-12-21T06:21:00.408ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57952024-12-21T06:21:00.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57962024-12-21T06:21:00.408ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57972024-12-21T06:21:00.408ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.354501ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57982024-12-21T06:21:00.409ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57992024-12-21T06:21:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58002024-12-21T06:21:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58012024-12-21T06:21:00.409ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.971407ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
58022024-12-21T06:21:00.410ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
58032024-12-21T06:21:00.410ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
58042024-12-21T06:21:00.410ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 54.124991ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
58052024-12-21T06:21:00.410ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58062024-12-21T06:21:00.410ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58072024-12-21T06:21:00.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58082024-12-21T06:21:00.411ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58092024-12-21T06:21:00.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58102024-12-21T06:21:00.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58112024-12-21T06:21:00.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58122024-12-21T06:21:00.413ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58132024-12-21T06:21:00.413ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58142024-12-21T06:21:00.414ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58152024-12-21T06:21:00.415ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1391, tv_nsec: 500501658 } })
58162024-12-21T06:21:00.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58172024-12-21T06:21:00.416ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
58182024-12-21T06:21:00.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58192024-12-21T06:21:00.416ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58202024-12-21T06:21:00.416ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58212024-12-21T06:21:00.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58222024-12-21T06:21:00.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
58232024-12-21T06:21:00.417ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58242024-12-21T06:21:00.417ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58252024-12-21T06:21:00.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58262024-12-21T06:21:00.417ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.967358ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
58272024-12-21T06:21:00.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58282024-12-21T06:21:00.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58292024-12-21T06:21:00.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
58302024-12-21T06:21:00.419ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58312024-12-21T06:21:00.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58322024-12-21T06:21:00.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58332024-12-21T06:21:00.421ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 65.96721ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58342024-12-21T06:21:00.422ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58352024-12-21T06:21:00.422ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58362024-12-21T06:21:00.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58372024-12-21T06:21:00.429ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
58382024-12-21T06:21:00.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
58392024-12-21T06:21:00.432ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58402024-12-21T06:21:00.432ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.931495ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58412024-12-21T06:21:00.444ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
58422024-12-21T06:21:00.445ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.653985ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
58432024-12-21T06:21:00.450ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
58442024-12-21T06:21:00.450ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
58452024-12-21T06:21:00.450ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.905043ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58462024-12-21T06:21:00.450ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 98.955735ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
58472024-12-21T06:21:00.450ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58482024-12-21T06:21:00.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58492024-12-21T06:21:00.455ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
58502024-12-21T06:21:00.455ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
58512024-12-21T06:21:00.455ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
58522024-12-21T06:21:00.455ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58532024-12-21T06:21:00.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f8161a0d-0d5f-4882-86b0-566811051ca6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
58542024-12-21T06:21:00.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58552024-12-21T06:21:00.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f8161a0d-0d5f-4882-86b0-566811051ca6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
58562024-12-21T06:21:00.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58572024-12-21T06:21:00.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58582024-12-21T06:21:00.458ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58592024-12-21T06:21:00.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2958 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f8161a0d-0d5f-4882-86b0-566811051ca6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
58602024-12-21T06:21:00.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
58612024-12-21T06:21:00.460ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58622024-12-21T06:21:00.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58632024-12-21T06:21:00.463ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 111.868513ms iteration = 15 status = 0
58642024-12-21T06:21:00.463ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58652024-12-21T06:21:00.463ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
58662024-12-21T06:21:00.463ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
58672024-12-21T06:21:00.463ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
58682024-12-21T06:21:00.463ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58692024-12-21T06:21:00.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58702024-12-21T06:21:00.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58712024-12-21T06:21:00.463ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58722024-12-21T06:21:00.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58732024-12-21T06:21:00.464ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58742024-12-21T06:21:00.464ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58752024-12-21T06:21:00.464ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58762024-12-21T06:21:00.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58772024-12-21T06:21:00.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58782024-12-21T06:21:00.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58792024-12-21T06:21:00.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58802024-12-21T06:21:00.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58812024-12-21T06:21:00.475ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58822024-12-21T06:21:00.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58832024-12-21T06:21:00.477ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58842024-12-21T06:21:00.480ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
58852024-12-21T06:21:00.480ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58862024-12-21T06:21:00.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58872024-12-21T06:21:00.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58882024-12-21T06:21:00.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58892024-12-21T06:21:00.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58902024-12-21T06:21:00.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58912024-12-21T06:21:00.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 137.475913ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
58922024-12-21T06:21:00.497ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58932024-12-21T06:21:00.497ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58942024-12-21T06:21:00.497ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.872016ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
58952024-12-21T06:21:00.508ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
58962024-12-21T06:21:00.508ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 0 version = 2
58972024-12-21T06:21:00.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58982024-12-21T06:21:00.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58992024-12-21T06:21:00.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59002024-12-21T06:21:00.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59012024-12-21T06:21:00.515ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59022024-12-21T06:21:00.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59032024-12-21T06:21:00.517ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 1 version = 2
59042024-12-21T06:21:00.517ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
59052024-12-21T06:21:00.517ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 06:14:08.776888 UTC dns_group = external generation = 2
59062024-12-21T06:21:00.517ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 166.952931ms iteration = 9 status = {"generation":2}
59072024-12-21T06:21:00.518ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59082024-12-21T06:21:00.518ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59092024-12-21T06:21:00.519ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c887684-ae5d-4ed9-94ba-25dbc064c7ae", "content-length": "26", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} })
59102024-12-21T06:21:00.519ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59112024-12-21T06:21:00.521ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59122024-12-21T06:21:00.526ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T06:13:58.796551Z, time_modified: 2024-12-21T06:13:58.796551Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }) }
59132024-12-21T06:21:00.526ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 176.368951ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]}},"default_endpoint":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
59142024-12-21T06:21:00.529ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
59152024-12-21T06:21:00.529ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
59162024-12-21T06:21:00.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59172024-12-21T06:21:00.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59182024-12-21T06:21:00.535ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 184.545998ms iteration = 18 status = {"physical_disks_added":0}
59192024-12-21T06:21:00.552ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
59202024-12-21T06:21:00.552ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 201.508869ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
59212024-12-21T06:21:00.561ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
59222024-12-21T06:21:00.567ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59232024-12-21T06:21:00.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59242024-12-21T06:21:00.644ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
59252024-12-21T06:21:00.659ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59262024-12-21T06:21:00.659ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59272024-12-21T06:21:00.659ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7952034b-534e-4747-ba39-2389fbf84f10", "content-length": "26", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} })
59282024-12-21T06:21:00.659ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59292024-12-21T06:21:00.660ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59302024-12-21T06:21:00.683ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
59312024-12-21T06:21:00.683ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f1813b6-a6bd-4271-92be-65047965359f", "content-length": "1", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} })
59322024-12-21T06:21:00.684ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59332024-12-21T06:21:00.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
59342024-12-21T06:21:00.688ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
59352024-12-21T06:21:00.688ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59362024-12-21T06:21:00.688ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "68999616-91b4-4daf-80ee-98e15b32049d", "content-length": "26", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} })
59372024-12-21T06:21:00.688ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59382024-12-21T06:21:00.690ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
59392024-12-21T06:21:00.724ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
59402024-12-21T06:21:00.724ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59412024-12-21T06:21:00.724ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fda8640-2947-4f31-95e7-7d15b893e3dc", "content-length": "372", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} })
59422024-12-21T06:21:00.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59432024-12-21T06:21:00.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59442024-12-21T06:21:00.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59452024-12-21T06:21:00.726ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59462024-12-21T06:21:00.726ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 376.515203ms iteration = 15 status = null
59472024-12-21T06:21:00.728ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59482024-12-21T06:21:00.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59492024-12-21T06:21:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59502024-12-21T06:21:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59512024-12-21T06:21:00.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59522024-12-21T06:21:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59532024-12-21T06:21:00.729ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59542024-12-21T06:21:00.731ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59552024-12-21T06:21:00.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59562024-12-21T06:21:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59572024-12-21T06:21:00.731ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
59582024-12-21T06:21:00.731ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
59592024-12-21T06:21:00.731ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 06:14:07.931887 UTC dns_group = internal generation = 1
59602024-12-21T06:21:00.731ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 381.509441ms iteration = 9 status = {"generation":1}
59612024-12-21T06:21:00.741ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
59622024-12-21T06:21:00.741ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
59632024-12-21T06:21:00.741ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "dfdc9bdb-1456-4ab0-8990-b79868e0c4e4", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} })
59642024-12-21T06:21:00.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59652024-12-21T06:21:00.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59662024-12-21T06:21:00.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59672024-12-21T06:21:00.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59682024-12-21T06:21:00.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59692024-12-21T06:21:00.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59702024-12-21T06:21:00.749ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
59712024-12-21T06:21:00.749ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
59722024-12-21T06:21:00.750ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9cee65d5-78c4-4d04-9e86-1c3e7fa937ef", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} })
59732024-12-21T06:21:00.751ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 395.615872ms iteration = 16 status = {}
59742024-12-21T06:21:00.769ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
59752024-12-21T06:21:00.769ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e34a349b-eb60-4473-ab4f-b2bb8e04dd9f", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59762024-12-21T06:21:00.769ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59772024-12-21T06:21:00.770ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f5cb7587-6e4c-443e-92a6-c240d46770f0", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59782024-12-21T06:21:00.770ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59792024-12-21T06:21:00.771ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
59802024-12-21T06:21:00.772ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 421.49089ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
59812024-12-21T06:21:00.781ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
59822024-12-21T06:21:00.789ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 438.80903ms iteration = 15 status = {}
59832024-12-21T06:21:00.875ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
59842024-12-21T06:21:00.875ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0ab03b0e-5646-4fd1-8215-b404d69e7eab", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
59852024-12-21T06:21:00.875ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
59862024-12-21T06:21:00.877ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "95fade13-217c-4b99-bf88-11e3581671a0", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
59872024-12-21T06:21:00.877ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
59882024-12-21T06:21:00.878ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59892024-12-21T06:21:00.878ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0eb2b980-5e59-477b-8881-be6ef733ac3f", "content-length": "691", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} })
59902024-12-21T06:21:00.878ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
59912024-12-21T06:21:00.878ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
59922024-12-21T06:21:00.878ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
59932024-12-21T06:21:00.878ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "3265b204-368a-4409-8e97-8a7c5cbc7635", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
59942024-12-21T06:21:00.878ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
59952024-12-21T06:21:00.880ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 529.438744ms iteration = 15 status = {}
59962024-12-21T06:21:00.880ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
59972024-12-21T06:21:00.880ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 530.248367ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
59982024-12-21T06:21:00.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59992024-12-21T06:21:00.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60002024-12-21T06:21:00.918ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
60012024-12-21T06:21:00.918ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60022024-12-21T06:21:00.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60032024-12-21T06:21:00.928ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60042024-12-21T06:21:00.928ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca42c50c-6c3f-4c04-82c9-5caa0d77a0e6", "content-length": "134", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} })
60052024-12-21T06:21:00.928ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60062024-12-21T06:21:00.928ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
60072024-12-21T06:21:00.928ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60082024-12-21T06:21:00.928ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60092024-12-21T06:21:00.928ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60102024-12-21T06:21:00.928ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60112024-12-21T06:21:00.928ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60122024-12-21T06:21:00.928ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60132024-12-21T06:21:00.928ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60142024-12-21T06:21:00.928ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60152024-12-21T06:21:00.928ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
60162024-12-21T06:21:00.928ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60172024-12-21T06:21:00.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60182024-12-21T06:21:00.931ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60192024-12-21T06:21:00.931ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7f0e719-ffa7-49ff-9fa9-8383dd9abebe", "content-length": "2", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} })
60202024-12-21T06:21:00.931ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60212024-12-21T06:21:00.931ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f63d16eb-6a07-4861-b9fe-a19ffb5d3bd7", "content-length": "52", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} })
60222024-12-21T06:21:00.931ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
60232024-12-21T06:21:00.931ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
60242024-12-21T06:21:01.030ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0c8013c9-08ae-4ecc-95b6-441ad92aec4f", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} })
60252024-12-21T06:21:01.030ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
60262024-12-21T06:21:01.030ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
60272024-12-21T06:21:01.030ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a8c556e-059d-47f9-8439-bd20d6728e29", "content-length": "682", "date": "Sat, 21 Dec 2024 06:21:00 GMT"} })
60282024-12-21T06:21:01.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60292024-12-21T06:21:01.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60302024-12-21T06:21:01.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60312024-12-21T06:21:01.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60322024-12-21T06:21:01.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60332024-12-21T06:21:01.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60342024-12-21T06:21:01.039ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60352024-12-21T06:21:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60362024-12-21T06:21:01.046ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 695.015936ms iteration = 15 status = {}
60372024-12-21T06:21:01.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = fc00c964-a9fd-4372-ad4e-e285cf673209 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
60382024-12-21T06:21:01.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = fc00c964-a9fd-4372-ad4e-e285cf673209 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
60392024-12-21T06:21:01.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2554 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = fc00c964-a9fd-4372-ad4e-e285cf673209 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
60402024-12-21T06:21:01.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = df706baa-f28c-4db8-894b-15b5f3716e4e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60412024-12-21T06:21:01.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = df706baa-f28c-4db8-894b-15b5f3716e4e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60422024-12-21T06:21:01.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = df706baa-f28c-4db8-894b-15b5f3716e4e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60432024-12-21T06:21:02.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 12697828-50a6-4330-843f-790cd65edf2c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60442024-12-21T06:21:02.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 12697828-50a6-4330-843f-790cd65edf2c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60452024-12-21T06:21:02.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 12697828-50a6-4330-843f-790cd65edf2c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60462024-12-21T06:21:03.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6722e4dd-1f7c-40da-8634-1d087249d526 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60472024-12-21T06:21:03.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6722e4dd-1f7c-40da-8634-1d087249d526 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60482024-12-21T06:21:03.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6722e4dd-1f7c-40da-8634-1d087249d526 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60492024-12-21T06:21:03.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1346 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = e0531ec4-076a-48a7-9d5e-35c5bea81eed response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
60502024-12-21T06:21:04.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 905a903c-abc2-4df0-84ca-4146004727ee roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60512024-12-21T06:21:04.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 905a903c-abc2-4df0-84ca-4146004727ee resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60522024-12-21T06:21:04.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 905a903c-abc2-4df0-84ca-4146004727ee response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60532024-12-21T06:21:05.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9808fabd-cc04-4c83-84b3-aa9d3e8e3baf roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60542024-12-21T06:21:05.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9808fabd-cc04-4c83-84b3-aa9d3e8e3baf resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60552024-12-21T06:21:05.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9808fabd-cc04-4c83-84b3-aa9d3e8e3baf response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60562024-12-21T06:21:06.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9ea36f5e-ba22-46ec-80e2-8e36f9d95ce7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60572024-12-21T06:21:06.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9ea36f5e-ba22-46ec-80e2-8e36f9d95ce7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60582024-12-21T06:21:06.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9ea36f5e-ba22-46ec-80e2-8e36f9d95ce7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60592024-12-21T06:21:07.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7af01b60-78ca-4e3c-b2cd-4230527f2dd8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60602024-12-21T06:21:07.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7af01b60-78ca-4e3c-b2cd-4230527f2dd8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60612024-12-21T06:21:07.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7af01b60-78ca-4e3c-b2cd-4230527f2dd8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60622024-12-21T06:21:08.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f180486e-2e75-49fd-ab28-81fd7d6f78ec roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60632024-12-21T06:21:08.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f180486e-2e75-49fd-ab28-81fd7d6f78ec resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60642024-12-21T06:21:08.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2595 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f180486e-2e75-49fd-ab28-81fd7d6f78ec response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60652024-12-21T06:21:09.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a6232941-0964-4bb3-b030-8cc84058feef roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60662024-12-21T06:21:09.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a6232941-0964-4bb3-b030-8cc84058feef resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60672024-12-21T06:21:09.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a6232941-0964-4bb3-b030-8cc84058feef response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60682024-12-21T06:21:10.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
60692024-12-21T06:21:10.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60702024-12-21T06:21:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60712024-12-21T06:21:10.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
60722024-12-21T06:21:10.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60732024-12-21T06:21:10.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60742024-12-21T06:21:10.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60752024-12-21T06:21:10.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60762024-12-21T06:21:10.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60772024-12-21T06:21:10.354ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.678322ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60782024-12-21T06:21:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60792024-12-21T06:21:10.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60802024-12-21T06:21:10.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60812024-12-21T06:21:10.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60822024-12-21T06:21:10.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60832024-12-21T06:21:10.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60842024-12-21T06:21:10.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
60852024-12-21T06:21:10.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60862024-12-21T06:21:10.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60872024-12-21T06:21:10.369ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
60882024-12-21T06:21:10.369ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.321355ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
60892024-12-21T06:21:10.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7c542cf2-dd91-4174-b3e6-d88d08488960 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60902024-12-21T06:21:10.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7c542cf2-dd91-4174-b3e6-d88d08488960 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60912024-12-21T06:21:10.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1935 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7c542cf2-dd91-4174-b3e6-d88d08488960 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60922024-12-21T06:21:11.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f3b54e8d-2876-4014-a1e9-ddef52b7f47d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60932024-12-21T06:21:11.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f3b54e8d-2876-4014-a1e9-ddef52b7f47d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60942024-12-21T06:21:11.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f3b54e8d-2876-4014-a1e9-ddef52b7f47d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60952024-12-21T06:21:12.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 27c5a42d-6d4a-4e85-9f2e-fc7ef9d390e9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60962024-12-21T06:21:12.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 27c5a42d-6d4a-4e85-9f2e-fc7ef9d390e9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60972024-12-21T06:21:12.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 27c5a42d-6d4a-4e85-9f2e-fc7ef9d390e9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60982024-12-21T06:21:13.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9a060d0c-c348-49ad-a2e9-aecf6d3d1229 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
60992024-12-21T06:21:13.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9a060d0c-c348-49ad-a2e9-aecf6d3d1229 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61002024-12-21T06:21:13.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2641 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9a060d0c-c348-49ad-a2e9-aecf6d3d1229 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61012024-12-21T06:21:13.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = c95fed70-b082-4ae3-ad87-34f42a412b17 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
61022024-12-21T06:21:13.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = c95fed70-b082-4ae3-ad87-34f42a412b17 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
61032024-12-21T06:21:13.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = c95fed70-b082-4ae3-ad87-34f42a412b17 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
61042024-12-21T06:21:13.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = e7c70b1e-4d51-4030-b8b7-fa644a634136 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
61052024-12-21T06:21:13.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = e7c70b1e-4d51-4030-b8b7-fa644a634136 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
61062024-12-21T06:21:13.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = e7c70b1e-4d51-4030-b8b7-fa644a634136 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
61072024-12-21T06:21:13.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1344 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 1584597b-7088-4b69-a97e-1617a8120ee5 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
61082024-12-21T06:21:14.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e080a99e-d906-491e-993b-ff0bcbd65913 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61092024-12-21T06:21:14.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e080a99e-d906-491e-993b-ff0bcbd65913 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61102024-12-21T06:21:14.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e080a99e-d906-491e-993b-ff0bcbd65913 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61112024-12-21T06:21:15.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78ec7ae9-8584-4275-97bb-afddf511a622 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61122024-12-21T06:21:15.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78ec7ae9-8584-4275-97bb-afddf511a622 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61132024-12-21T06:21:15.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78ec7ae9-8584-4275-97bb-afddf511a622 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61142024-12-21T06:21:16.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4d32ad32-e233-43ba-aa84-e674ba8a5611 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61152024-12-21T06:21:16.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4d32ad32-e233-43ba-aa84-e674ba8a5611 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61162024-12-21T06:21:16.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4d32ad32-e233-43ba-aa84-e674ba8a5611 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61172024-12-21T06:21:17.829ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9cd7e9fd-8ad4-4ac4-acf5-f291eef18dd7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61182024-12-21T06:21:17.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9cd7e9fd-8ad4-4ac4-acf5-f291eef18dd7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61192024-12-21T06:21:17.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9cd7e9fd-8ad4-4ac4-acf5-f291eef18dd7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61202024-12-21T06:21:18.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5d296841-aade-4d67-9c94-b657d3364b3c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61212024-12-21T06:21:18.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5d296841-aade-4d67-9c94-b657d3364b3c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61222024-12-21T06:21:18.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5d296841-aade-4d67-9c94-b657d3364b3c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61232024-12-21T06:21:19.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5b8b0e70-0773-47fa-9c33-0895596cad82 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61242024-12-21T06:21:19.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5b8b0e70-0773-47fa-9c33-0895596cad82 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61252024-12-21T06:21:19.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5b8b0e70-0773-47fa-9c33-0895596cad82 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61262024-12-21T06:21:20.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
61272024-12-21T06:21:20.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61282024-12-21T06:21:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61292024-12-21T06:21:20.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
61302024-12-21T06:21:20.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61312024-12-21T06:21:20.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61322024-12-21T06:21:20.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61332024-12-21T06:21:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61342024-12-21T06:21:20.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61352024-12-21T06:21:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61362024-12-21T06:21:20.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61372024-12-21T06:21:20.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61382024-12-21T06:21:20.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61392024-12-21T06:21:20.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
61402024-12-21T06:21:20.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61412024-12-21T06:21:20.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61422024-12-21T06:21:20.372ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
61432024-12-21T06:21:20.372ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.496314ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
61442024-12-21T06:21:20.385ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61452024-12-21T06:21:20.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61462024-12-21T06:21:20.387ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.570705ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61472024-12-21T06:21:20.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 61c27150-2a1e-4892-96d5-2930dd69cc0f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61482024-12-21T06:21:20.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 61c27150-2a1e-4892-96d5-2930dd69cc0f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61492024-12-21T06:21:20.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 61c27150-2a1e-4892-96d5-2930dd69cc0f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61502024-12-21T06:21:21.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0bfb3d4a-fa5e-45e3-a448-370be03b8665 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61512024-12-21T06:21:21.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0bfb3d4a-fa5e-45e3-a448-370be03b8665 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61522024-12-21T06:21:21.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0bfb3d4a-fa5e-45e3-a448-370be03b8665 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61532024-12-21T06:21:22.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 41874f3a-5299-4775-bed0-3a6e38e8a65a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61542024-12-21T06:21:22.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 41874f3a-5299-4775-bed0-3a6e38e8a65a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61552024-12-21T06:21:22.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 41874f3a-5299-4775-bed0-3a6e38e8a65a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61562024-12-21T06:21:23.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e6363ab2-0361-413f-9097-614e0825baed roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61572024-12-21T06:21:23.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e6363ab2-0361-413f-9097-614e0825baed resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61582024-12-21T06:21:23.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e6363ab2-0361-413f-9097-614e0825baed response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61592024-12-21T06:21:23.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1254 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 217492cd-ea33-411f-a9f5-030bbe28e94e response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
61602024-12-21T06:21:24.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f4947279-d51c-4a25-9d7b-93669683ecf8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61612024-12-21T06:21:24.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f4947279-d51c-4a25-9d7b-93669683ecf8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61622024-12-21T06:21:24.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f4947279-d51c-4a25-9d7b-93669683ecf8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61632024-12-21T06:21:25.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d5b025ad-fe5e-4080-8572-964ef6a6c116 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61642024-12-21T06:21:25.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d5b025ad-fe5e-4080-8572-964ef6a6c116 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61652024-12-21T06:21:26.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2484 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d5b025ad-fe5e-4080-8572-964ef6a6c116 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61662024-12-21T06:21:27.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d8f9598e-fb8d-492b-9761-d087cf60fe17 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61672024-12-21T06:21:27.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d8f9598e-fb8d-492b-9761-d087cf60fe17 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61682024-12-21T06:21:27.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d8f9598e-fb8d-492b-9761-d087cf60fe17 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61692024-12-21T06:21:28.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2fb17edb-7d51-435a-9cc1-a633fce5ef29 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61702024-12-21T06:21:28.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2fb17edb-7d51-435a-9cc1-a633fce5ef29 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61712024-12-21T06:21:28.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2586 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2fb17edb-7d51-435a-9cc1-a633fce5ef29 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61722024-12-21T06:21:29.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 47b6e03a-a20f-41ac-94bd-40d8204e7e6f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61732024-12-21T06:21:29.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 47b6e03a-a20f-41ac-94bd-40d8204e7e6f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61742024-12-21T06:21:29.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1680 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 47b6e03a-a20f-41ac-94bd-40d8204e7e6f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61752024-12-21T06:21:30.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fde8dcb0-06ff-4d0c-ae92-3818382ee5af roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61762024-12-21T06:21:30.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fde8dcb0-06ff-4d0c-ae92-3818382ee5af resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61772024-12-21T06:21:30.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fde8dcb0-06ff-4d0c-ae92-3818382ee5af response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
61782024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
61792024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61802024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
61812024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
61822024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61832024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
61842024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61852024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
61862024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
61872024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61882024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61892024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
61902024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
61912024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61922024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
61932024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61942024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61952024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
61962024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61972024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61982024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
61992024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62002024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
62012024-12-21T06:21:30.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62022024-12-21T06:21:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62032024-12-21T06:21:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62042024-12-21T06:21:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62052024-12-21T06:21:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62062024-12-21T06:21:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62072024-12-21T06:21:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62082024-12-21T06:21:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62092024-12-21T06:21:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62102024-12-21T06:21:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62112024-12-21T06:21:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62122024-12-21T06:21:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62132024-12-21T06:21:30.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62142024-12-21T06:21:30.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1421, tv_nsec: 437951383 } })
62152024-12-21T06:21:30.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
62162024-12-21T06:21:30.353ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62172024-12-21T06:21:30.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62182024-12-21T06:21:30.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62192024-12-21T06:21:30.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62202024-12-21T06:21:30.354ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.665732ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62212024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62222024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62232024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62242024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
62252024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
62262024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62272024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62282024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
62292024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62302024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
62312024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62322024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
62332024-12-21T06:21:30.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62342024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62352024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62362024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62372024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62382024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62392024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62402024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62412024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62422024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62432024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62442024-12-21T06:21:30.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62452024-12-21T06:21:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62462024-12-21T06:21:30.357ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62472024-12-21T06:21:30.359ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62482024-12-21T06:21:30.359ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62492024-12-21T06:21:30.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62502024-12-21T06:21:30.359ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1421, tv_nsec: 443989221 } })
62512024-12-21T06:21:30.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62522024-12-21T06:21:30.359ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
62532024-12-21T06:21:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62542024-12-21T06:21:30.360ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62552024-12-21T06:21:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62562024-12-21T06:21:30.361ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 10.779749ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62572024-12-21T06:21:30.362ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62582024-12-21T06:21:30.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62592024-12-21T06:21:30.362ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.420518ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
62602024-12-21T06:21:30.364ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62612024-12-21T06:21:30.365ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1421, tv_nsec: 450592824 } })
62622024-12-21T06:21:30.366ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62632024-12-21T06:21:30.366ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62642024-12-21T06:21:30.366ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
62652024-12-21T06:21:30.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62662024-12-21T06:21:30.366ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62672024-12-21T06:21:30.366ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62682024-12-21T06:21:30.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62692024-12-21T06:21:30.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62702024-12-21T06:21:30.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62712024-12-21T06:21:30.367ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62722024-12-21T06:21:30.367ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62732024-12-21T06:21:30.367ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62742024-12-21T06:21:30.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62752024-12-21T06:21:30.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62762024-12-21T06:21:30.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
62772024-12-21T06:21:30.369ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62782024-12-21T06:21:30.369ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62792024-12-21T06:21:30.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62802024-12-21T06:21:30.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62812024-12-21T06:21:30.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62822024-12-21T06:21:30.394ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
62832024-12-21T06:21:30.394ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 43.359272ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
62842024-12-21T06:21:30.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62852024-12-21T06:21:30.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62862024-12-21T06:21:30.396ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62872024-12-21T06:21:30.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62882024-12-21T06:21:30.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62892024-12-21T06:21:30.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62902024-12-21T06:21:30.397ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62912024-12-21T06:21:30.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62922024-12-21T06:21:30.399ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62932024-12-21T06:21:30.399ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62942024-12-21T06:21:30.399ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 48.390702ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62952024-12-21T06:21:30.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62962024-12-21T06:21:30.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62972024-12-21T06:21:30.400ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 43.799055ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
62982024-12-21T06:21:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62992024-12-21T06:21:30.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63002024-12-21T06:21:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63012024-12-21T06:21:30.402ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.066438ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
63022024-12-21T06:21:30.403ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 46.677445ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63032024-12-21T06:21:30.403ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63042024-12-21T06:21:30.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63052024-12-21T06:21:30.404ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63062024-12-21T06:21:30.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63072024-12-21T06:21:30.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63082024-12-21T06:21:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63092024-12-21T06:21:30.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63102024-12-21T06:21:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63112024-12-21T06:21:30.409ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63122024-12-21T06:21:30.409ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63132024-12-21T06:21:30.409ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 58.891063ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63142024-12-21T06:21:30.414ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 63.940714ms iteration = 19 status = {"physical_disks_added":0}
63152024-12-21T06:21:30.429ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63162024-12-21T06:21:30.432ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.562682ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63172024-12-21T06:21:30.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
63182024-12-21T06:21:30.432ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63192024-12-21T06:21:30.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63202024-12-21T06:21:30.434ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.167907ms iteration = 16 status = 0
63212024-12-21T06:21:30.439ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
63222024-12-21T06:21:30.439ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63232024-12-21T06:21:30.439ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b01904a3-9fda-4605-a18e-62cf9d181c50", "content-length": "26", "date": "Sat, 21 Dec 2024 06:21:30 GMT"} })
63242024-12-21T06:21:30.439ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63252024-12-21T06:21:30.440ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63262024-12-21T06:21:30.485ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
63272024-12-21T06:21:30.485ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63282024-12-21T06:21:30.485ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dd6e3cb-b1b8-4e9f-a4bd-1e18ea9728b9", "content-length": "26", "date": "Sat, 21 Dec 2024 06:21:30 GMT"} })
63292024-12-21T06:21:30.485ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63302024-12-21T06:21:30.486ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63312024-12-21T06:21:30.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63322024-12-21T06:21:30.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63332024-12-21T06:21:30.610ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
63342024-12-21T06:21:30.610ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63352024-12-21T06:21:30.610ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "165d2ec2-ff60-4911-9ce2-12e2326deff7", "content-length": "26", "date": "Sat, 21 Dec 2024 06:21:30 GMT"} })
63362024-12-21T06:21:30.611ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63372024-12-21T06:21:30.612ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
63382024-12-21T06:21:30.679ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63392024-12-21T06:21:30.679ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "526cbb22-89ce-4b43-86a4-69d77d018d82", "content-length": "1", "date": "Sat, 21 Dec 2024 06:21:30 GMT"} })
63402024-12-21T06:21:30.681ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63412024-12-21T06:21:30.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63422024-12-21T06:21:30.691ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
63432024-12-21T06:21:30.691ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63442024-12-21T06:21:30.691ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a7a97e4-90c8-45b5-a632-6afd594bc13f", "content-length": "372", "date": "Sat, 21 Dec 2024 06:21:30 GMT"} })
63452024-12-21T06:21:30.691ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63462024-12-21T06:21:30.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63472024-12-21T06:21:30.693ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63482024-12-21T06:21:30.693ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 343.095356ms iteration = 16 status = {}
63492024-12-21T06:21:30.693ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 343.139127ms iteration = 16 status = null
63502024-12-21T06:21:30.695ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63512024-12-21T06:21:30.695ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63522024-12-21T06:21:30.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63532024-12-21T06:21:30.697ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63542024-12-21T06:21:30.699ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63552024-12-21T06:21:30.699ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63562024-12-21T06:21:30.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63572024-12-21T06:21:30.712ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
63582024-12-21T06:21:30.712ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
63592024-12-21T06:21:30.712ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a831aa8d-906e-4c68-8c3d-2405a2e9196b", "date": "Sat, 21 Dec 2024 06:21:30 GMT"} })
63602024-12-21T06:21:30.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63612024-12-21T06:21:30.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63622024-12-21T06:21:30.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63632024-12-21T06:21:30.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63642024-12-21T06:21:30.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63652024-12-21T06:21:30.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63662024-12-21T06:21:30.720ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
63672024-12-21T06:21:30.720ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63682024-12-21T06:21:30.721ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bf1ec7b5-bd18-40c6-8736-0001ba742b2a", "date": "Sat, 21 Dec 2024 06:21:30 GMT"} })
63692024-12-21T06:21:30.722ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 365.94589ms iteration = 17 status = {}
63702024-12-21T06:21:30.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63712024-12-21T06:21:30.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63722024-12-21T06:21:30.797ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63732024-12-21T06:21:30.797ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba1d20ff-58b6-4176-9d46-43cdb7192096", "content-length": "691", "date": "Sat, 21 Dec 2024 06:21:30 GMT"} })
63742024-12-21T06:21:30.797ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
63752024-12-21T06:21:30.797ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
63762024-12-21T06:21:30.797ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
63772024-12-21T06:21:30.798ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 447.614205ms iteration = 16 status = {}
63782024-12-21T06:21:30.799ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
63792024-12-21T06:21:30.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63802024-12-21T06:21:30.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63812024-12-21T06:21:30.808ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63822024-12-21T06:21:30.808ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "79219079-d8bc-4bbe-8661-097422140471", "content-length": "134", "date": "Sat, 21 Dec 2024 06:21:30 GMT"} })
63832024-12-21T06:21:30.809ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
63842024-12-21T06:21:30.809ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
63852024-12-21T06:21:30.809ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63862024-12-21T06:21:30.809ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63872024-12-21T06:21:30.809ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63882024-12-21T06:21:30.809ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63892024-12-21T06:21:30.809ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63902024-12-21T06:21:30.809ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63912024-12-21T06:21:30.809ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63922024-12-21T06:21:30.809ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63932024-12-21T06:21:30.809ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
63942024-12-21T06:21:30.809ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63952024-12-21T06:21:30.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63962024-12-21T06:21:30.811ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63972024-12-21T06:21:30.811ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c68b5b76-d5ba-4396-9c68-71ea88306c15", "content-length": "2", "date": "Sat, 21 Dec 2024 06:21:30 GMT"} })
63982024-12-21T06:21:30.811ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63992024-12-21T06:21:30.811ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "fefbf6ac-b205-4721-8868-bf141c6fb6ef", "content-length": "52", "date": "Sat, 21 Dec 2024 06:21:30 GMT"} })
64002024-12-21T06:21:30.811ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
64012024-12-21T06:21:30.811ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64022024-12-21T06:21:30.904ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "55c3d1e0-1c1d-445a-b2a7-535e1948e3fc", "date": "Sat, 21 Dec 2024 06:21:30 GMT"} })
64032024-12-21T06:21:30.904ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
64042024-12-21T06:21:30.904ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64052024-12-21T06:21:30.904ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bccd761-69d7-45e4-b029-da4535c72e37", "content-length": "682", "date": "Sat, 21 Dec 2024 06:21:30 GMT"} })
64062024-12-21T06:21:30.905ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64072024-12-21T06:21:30.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64082024-12-21T06:21:30.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64092024-12-21T06:21:30.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64102024-12-21T06:21:30.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64112024-12-21T06:21:30.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64122024-12-21T06:21:30.916ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64132024-12-21T06:21:30.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64142024-12-21T06:21:30.923ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 572.890619ms iteration = 16 status = {}
64152024-12-21T06:21:31.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 467fae85-a73b-4827-aa7a-9c8ccf2a43b6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64162024-12-21T06:21:31.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 467fae85-a73b-4827-aa7a-9c8ccf2a43b6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64172024-12-21T06:21:31.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 467fae85-a73b-4827-aa7a-9c8ccf2a43b6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64182024-12-21T06:21:31.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 2d67d536-a9c3-4c36-98dd-187aba4811ad roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
64192024-12-21T06:21:31.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 2d67d536-a9c3-4c36-98dd-187aba4811ad resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
64202024-12-21T06:21:31.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 2d67d536-a9c3-4c36-98dd-187aba4811ad response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
64212024-12-21T06:21:32.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1390c998-9f8a-42a6-bf46-a158e25b40f4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64222024-12-21T06:21:32.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1390c998-9f8a-42a6-bf46-a158e25b40f4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64232024-12-21T06:21:32.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1390c998-9f8a-42a6-bf46-a158e25b40f4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64242024-12-21T06:21:33.133ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:56195
64252024-12-21T06:21:33.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56195 req_id = e5931eee-47ae-40e5-8332-615f337e6873 roles = RoleSet { roles: {} } uri = /metrics/producers
64262024-12-21T06:21:33.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56195 req_id = e5931eee-47ae-40e5-8332-615f337e6873 resource = Database result = Ok(()) uri = /metrics/producers
64272024-12-21T06:21:33.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 21a2eaa9-4f84-4356-af53-2eae401ded4b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64282024-12-21T06:21:33.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 21a2eaa9-4f84-4356-af53-2eae401ded4b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64292024-12-21T06:21:33.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 21a2eaa9-4f84-4356-af53-2eae401ded4b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64302024-12-21T06:21:33.166ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 98955a77-d432-4135-98da-54d3ff354ace
64312024-12-21T06:21:33.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33106 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:56195 req_id = e5931eee-47ae-40e5-8332-615f337e6873 response_code = 201 uri = /metrics/producers
64322024-12-21T06:21:33.770ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:50998
64332024-12-21T06:21:33.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50998 req_id = 45dd901a-76cb-456f-9d12-cbbb10bc6691 roles = RoleSet { roles: {} } uri = /metrics/producers
64342024-12-21T06:21:33.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50998 req_id = 45dd901a-76cb-456f-9d12-cbbb10bc6691 resource = Database result = Ok(()) uri = /metrics/producers
64352024-12-21T06:21:33.805ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = d1b17d65-9e31-4f7b-88f5-d7566540099b
64362024-12-21T06:21:33.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35089 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:50998 req_id = 45dd901a-76cb-456f-9d12-cbbb10bc6691 response_code = 201 uri = /metrics/producers
64372024-12-21T06:21:33.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1248 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 362b2e6f-23a5-49f8-aa47-76bb680243d0 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
64382024-12-21T06:21:34.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eb0ca5bc-8b25-4889-b697-102891ff32b8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64392024-12-21T06:21:34.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eb0ca5bc-8b25-4889-b697-102891ff32b8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64402024-12-21T06:21:34.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eb0ca5bc-8b25-4889-b697-102891ff32b8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64412024-12-21T06:21:35.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1ddb708d-70c5-4c62-8f75-392eb410f4b5 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64422024-12-21T06:21:35.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1ddb708d-70c5-4c62-8f75-392eb410f4b5 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64432024-12-21T06:21:35.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1ddb708d-70c5-4c62-8f75-392eb410f4b5 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64442024-12-21T06:21:35.506ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:41804
64452024-12-21T06:21:35.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41804 req_id = 15aaf780-3d0d-413d-a8fd-a09675b35ea5 roles = RoleSet { roles: {} } uri = /metrics/producers
64462024-12-21T06:21:35.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41804 req_id = 15aaf780-3d0d-413d-a8fd-a09675b35ea5 resource = Database result = Ok(()) uri = /metrics/producers
64472024-12-21T06:21:35.515ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 0816076d-2e0e-472b-89a8-a9ecbfd48b43
64482024-12-21T06:21:35.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8915 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:41804 req_id = 15aaf780-3d0d-413d-a8fd-a09675b35ea5 response_code = 201 uri = /metrics/producers
64492024-12-21T06:21:36.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cdf52bad-7a2a-4ae5-99a6-45b11df0a13d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64502024-12-21T06:21:36.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cdf52bad-7a2a-4ae5-99a6-45b11df0a13d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64512024-12-21T06:21:36.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cdf52bad-7a2a-4ae5-99a6-45b11df0a13d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64522024-12-21T06:21:37.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff9824ed-d2a2-4c34-91db-2c1924bb241a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64532024-12-21T06:21:37.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff9824ed-d2a2-4c34-91db-2c1924bb241a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64542024-12-21T06:21:37.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff9824ed-d2a2-4c34-91db-2c1924bb241a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64552024-12-21T06:21:37.635ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:55424
64562024-12-21T06:21:37.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55424 req_id = 450e96b7-f262-4526-8a3c-535ec62b86a3 roles = RoleSet { roles: {} } uri = /metrics/producers
64572024-12-21T06:21:37.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55424 req_id = 450e96b7-f262-4526-8a3c-535ec62b86a3 resource = Database result = Ok(()) uri = /metrics/producers
64582024-12-21T06:21:37.674ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
64592024-12-21T06:21:37.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39342 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55424 req_id = 450e96b7-f262-4526-8a3c-535ec62b86a3 response_code = 201 uri = /metrics/producers
64602024-12-21T06:21:38.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a923bb12-ddf8-43ba-bcb7-e9b7b19f335d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64612024-12-21T06:21:38.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a923bb12-ddf8-43ba-bcb7-e9b7b19f335d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64622024-12-21T06:21:38.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1752 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a923bb12-ddf8-43ba-bcb7-e9b7b19f335d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64632024-12-21T06:21:39.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2687c032-5371-46c3-8466-dfbb2f5e3c64 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64642024-12-21T06:21:39.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2687c032-5371-46c3-8466-dfbb2f5e3c64 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64652024-12-21T06:21:39.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2687c032-5371-46c3-8466-dfbb2f5e3c64 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64662024-12-21T06:21:40.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 979a99b5-a65c-48dc-b84a-ded8a5aa6cb5 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64672024-12-21T06:21:40.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 979a99b5-a65c-48dc-b84a-ded8a5aa6cb5 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64682024-12-21T06:21:40.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 979a99b5-a65c-48dc-b84a-ded8a5aa6cb5 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
64692024-12-21T06:21:40.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
64702024-12-21T06:21:40.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64712024-12-21T06:21:40.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64722024-12-21T06:21:40.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
64732024-12-21T06:21:40.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64742024-12-21T06:21:40.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64752024-12-21T06:21:40.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64762024-12-21T06:21:40.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64772024-12-21T06:21:40.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64782024-12-21T06:21:40.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64792024-12-21T06:21:40.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64802024-12-21T06:21:40.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64812024-12-21T06:21:40.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64822024-12-21T06:21:40.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
64832024-12-21T06:21:40.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64842024-12-21T06:21:40.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64852024-12-21T06:21:40.374ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
64862024-12-21T06:21:40.374ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.473699ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
64872024-12-21T06:21:40.380ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64882024-12-21T06:21:40.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64892024-12-21T06:21:40.381ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.833405ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64902024-12-21T06:21:40.502ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
64912024-12-21T06:21:40.502ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
64922024-12-21T06:21:40.533ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
64932024-12-21T06:21:40.533ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:40479
64942024-12-21T06:21:40.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40479 req_id = de66e68e-cbec-42ab-bd2c-a6eae2081600 roles = RoleSet { roles: {} } uri = /metrics/producers
64952024-12-21T06:21:40.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40479 req_id = de66e68e-cbec-42ab-bd2c-a6eae2081600 resource = Database result = Ok(()) uri = /metrics/producers
64962024-12-21T06:21:40.542ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
64972024-12-21T06:21:40.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8863 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40479 req_id = de66e68e-cbec-42ab-bd2c-a6eae2081600 response_code = 201 uri = /metrics/producers
64982024-12-21T06:21:40.542ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "de66e68e-cbec-42ab-bd2c-a6eae2081600", "content-length": "41", "date": "Sat, 21 Dec 2024 06:21:40 GMT"} })
64992024-12-21T06:21:40.544ZDEBGnexus (producer-registration-task): registered with nexus successfully
65002024-12-21T06:21:40.544ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
65012024-12-21T06:21:41.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dbbc0a58-53c0-4f51-b039-07ced3668844 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65022024-12-21T06:21:41.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dbbc0a58-53c0-4f51-b039-07ced3668844 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65032024-12-21T06:21:41.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dbbc0a58-53c0-4f51-b039-07ced3668844 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65042024-12-21T06:21:42.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2d90d7b0-57e6-4e04-831f-e0b7404f4658 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65052024-12-21T06:21:42.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2d90d7b0-57e6-4e04-831f-e0b7404f4658 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65062024-12-21T06:21:42.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2d90d7b0-57e6-4e04-831f-e0b7404f4658 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65072024-12-21T06:21:43.194ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:46365
65082024-12-21T06:21:43.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46365 req_id = 4a1ee7e5-df71-4d1d-8910-caf2ee70df16 roles = RoleSet { roles: {} } uri = /metrics/producers
65092024-12-21T06:21:43.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46365 req_id = 4a1ee7e5-df71-4d1d-8910-caf2ee70df16 resource = Database result = Ok(()) uri = /metrics/producers
65102024-12-21T06:21:43.229ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 49f39df6-9f0d-49d5-a626-07ee31ec1ff4
65112024-12-21T06:21:43.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35299 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:46365 req_id = 4a1ee7e5-df71-4d1d-8910-caf2ee70df16 response_code = 201 uri = /metrics/producers
65122024-12-21T06:21:43.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cea0efb3-26d3-455f-bbf4-0aad835e44d7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65132024-12-21T06:21:43.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cea0efb3-26d3-455f-bbf4-0aad835e44d7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65142024-12-21T06:21:43.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cea0efb3-26d3-455f-bbf4-0aad835e44d7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65152024-12-21T06:21:43.640ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:54306
65162024-12-21T06:21:43.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54306 req_id = 38ff131b-4f9a-4b18-9e36-768ac2b96ff6 roles = RoleSet { roles: {} } uri = /metrics/producers
65172024-12-21T06:21:43.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54306 req_id = 38ff131b-4f9a-4b18-9e36-768ac2b96ff6 resource = Database result = Ok(()) uri = /metrics/producers
65182024-12-21T06:21:43.650ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 47090b0b-c8ad-4dca-92e5-38fed29ad6d5
65192024-12-21T06:21:43.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9490 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54306 req_id = 38ff131b-4f9a-4b18-9e36-768ac2b96ff6 response_code = 201 uri = /metrics/producers
65202024-12-21T06:21:43.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1401 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 1ba08436-9122-447c-b90e-8bc9ecf42a95 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
65212024-12-21T06:21:44.385ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8317158c-ac3a-4a57-a652-100622f865b6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65222024-12-21T06:21:44.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8317158c-ac3a-4a57-a652-100622f865b6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65232024-12-21T06:21:44.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8317158c-ac3a-4a57-a652-100622f865b6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65242024-12-21T06:21:45.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1f477260-6221-4537-862b-1f38c9ea47e6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65252024-12-21T06:21:45.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1f477260-6221-4537-862b-1f38c9ea47e6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65262024-12-21T06:21:45.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1f477260-6221-4537-862b-1f38c9ea47e6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65272024-12-21T06:21:46.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f9ced22a-8b1a-4515-b6b1-d1c1bc99d0c0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65282024-12-21T06:21:46.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f9ced22a-8b1a-4515-b6b1-d1c1bc99d0c0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65292024-12-21T06:21:46.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f9ced22a-8b1a-4515-b6b1-d1c1bc99d0c0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65302024-12-21T06:21:47.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 24c08d90-0697-4b44-b569-085b569ad8b1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65312024-12-21T06:21:47.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 24c08d90-0697-4b44-b569-085b569ad8b1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65322024-12-21T06:21:47.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 24c08d90-0697-4b44-b569-085b569ad8b1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65332024-12-21T06:21:48.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 39ae9ea1-c47f-41b5-8a38-7b58a97bfa80 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65342024-12-21T06:21:48.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 39ae9ea1-c47f-41b5-8a38-7b58a97bfa80 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65352024-12-21T06:21:48.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1942 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 39ae9ea1-c47f-41b5-8a38-7b58a97bfa80 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65362024-12-21T06:21:49.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3fac08f0-4170-4862-b0a6-4cee5c27eac0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65372024-12-21T06:21:49.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3fac08f0-4170-4862-b0a6-4cee5c27eac0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65382024-12-21T06:21:49.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3fac08f0-4170-4862-b0a6-4cee5c27eac0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65392024-12-21T06:21:50.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
65402024-12-21T06:21:50.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65412024-12-21T06:21:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65422024-12-21T06:21:50.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
65432024-12-21T06:21:50.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65442024-12-21T06:21:50.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65452024-12-21T06:21:50.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65462024-12-21T06:21:50.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65472024-12-21T06:21:50.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65482024-12-21T06:21:50.354ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.824376ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65492024-12-21T06:21:50.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65502024-12-21T06:21:50.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65512024-12-21T06:21:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65522024-12-21T06:21:50.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65532024-12-21T06:21:50.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65542024-12-21T06:21:50.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65552024-12-21T06:21:50.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
65562024-12-21T06:21:50.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65572024-12-21T06:21:50.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65582024-12-21T06:21:50.372ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
65592024-12-21T06:21:50.372ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.361981ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
65602024-12-21T06:21:50.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 92bd68ce-708e-4641-ab3d-f8b1d37cc256 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65612024-12-21T06:21:50.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 92bd68ce-708e-4641-ab3d-f8b1d37cc256 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65622024-12-21T06:21:50.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 92bd68ce-708e-4641-ab3d-f8b1d37cc256 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65632024-12-21T06:21:51.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d849eeea-1e77-45ed-b252-e0276c5a4c11 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65642024-12-21T06:21:51.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d849eeea-1e77-45ed-b252-e0276c5a4c11 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65652024-12-21T06:21:51.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1806 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d849eeea-1e77-45ed-b252-e0276c5a4c11 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65662024-12-21T06:21:52.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e645e969-13bb-4da5-b139-504004592735 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65672024-12-21T06:21:52.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e645e969-13bb-4da5-b139-504004592735 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65682024-12-21T06:21:52.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e645e969-13bb-4da5-b139-504004592735 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65692024-12-21T06:21:53.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf55ea48-7744-473e-a9d3-f380d2843215 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65702024-12-21T06:21:53.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf55ea48-7744-473e-a9d3-f380d2843215 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65712024-12-21T06:21:53.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf55ea48-7744-473e-a9d3-f380d2843215 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65722024-12-21T06:21:53.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1407 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 84245881-1b2f-4fa6-81a4-b8159e58c1d1 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
65732024-12-21T06:21:54.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78f2a01e-abb4-4db8-a826-8db6a5f9144d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65742024-12-21T06:21:54.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78f2a01e-abb4-4db8-a826-8db6a5f9144d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65752024-12-21T06:21:54.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78f2a01e-abb4-4db8-a826-8db6a5f9144d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65762024-12-21T06:21:55.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b695139e-46bd-4536-b880-9a4cd874c5a0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65772024-12-21T06:21:55.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b695139e-46bd-4536-b880-9a4cd874c5a0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65782024-12-21T06:21:55.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b695139e-46bd-4536-b880-9a4cd874c5a0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65792024-12-21T06:21:56.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 50f5e3f5-91ce-4190-ac96-f07461ebd44c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65802024-12-21T06:21:56.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 50f5e3f5-91ce-4190-ac96-f07461ebd44c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65812024-12-21T06:21:56.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 50f5e3f5-91ce-4190-ac96-f07461ebd44c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65822024-12-21T06:21:57.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2f31d1c2-7074-4e75-8048-b31a502d596a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65832024-12-21T06:21:57.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2f31d1c2-7074-4e75-8048-b31a502d596a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65842024-12-21T06:21:57.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2f31d1c2-7074-4e75-8048-b31a502d596a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65852024-12-21T06:21:58.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 932810ef-769f-4b16-a8a2-751ab814c09d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65862024-12-21T06:21:58.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 932810ef-769f-4b16-a8a2-751ab814c09d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65872024-12-21T06:21:58.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 932810ef-769f-4b16-a8a2-751ab814c09d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65882024-12-21T06:21:58.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 210e4f97-2817-4ad5-be01-7449544a300b roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
65892024-12-21T06:21:58.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 210e4f97-2817-4ad5-be01-7449544a300b resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
65902024-12-21T06:21:58.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 210e4f97-2817-4ad5-be01-7449544a300b response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
65912024-12-21T06:21:58.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 3469b470-2cc2-4569-915b-e6282d4f6063 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
65922024-12-21T06:21:58.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 3469b470-2cc2-4569-915b-e6282d4f6063 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
65932024-12-21T06:21:58.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 3469b470-2cc2-4569-915b-e6282d4f6063 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
65942024-12-21T06:21:59.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0e07284d-b0f6-4603-81fe-2cbfcfda2cf1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65952024-12-21T06:21:59.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0e07284d-b0f6-4603-81fe-2cbfcfda2cf1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65962024-12-21T06:21:59.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0e07284d-b0f6-4603-81fe-2cbfcfda2cf1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
65972024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
65982024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
65992024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66002024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
66012024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66022024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
66032024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
66042024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
66052024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
66062024-12-21T06:22:00.349ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 06:12:00.349818812 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
66072024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
66082024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66092024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
66102024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66112024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
66122024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66132024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
66142024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
66152024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
66162024-12-21T06:22:00.349ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
66172024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
66182024-12-21T06:22:00.350ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 7c419228-2431-4394-af83-ea0457364b70
66192024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.821\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"7c419228-2431-4394-af83-ea0457364b70"}
66202024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
66212024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66222024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
66232024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66242024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66252024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66262024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66272024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66282024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66292024-12-21T06:22:00.350ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1451, tv_nsec: 435495915 } })
66302024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
66312024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66322024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
66332024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66342024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66352024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
66362024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66372024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
66382024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
66392024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66402024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
66412024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
66422024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66432024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
66442024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66452024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
66462024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
66472024-12-21T06:22:00.350ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
66482024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66492024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66502024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
66512024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66522024-12-21T06:22:00.350ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("068965c6-3480-4953-b57e-dd969abb2a21.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("45c0a855-5592-491c-b7b3-470902319db2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1451, tv_nsec: 435711941 } })
66532024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66542024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66552024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66562024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66572024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
66582024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66592024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
66602024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.050249ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
66612024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
66622024-12-21T06:22:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66632024-12-21T06:22:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66642024-12-21T06:22:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66652024-12-21T06:22:00.351ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
66662024-12-21T06:22:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.43928ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
66672024-12-21T06:22:00.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66682024-12-21T06:22:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66692024-12-21T06:22:00.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66702024-12-21T06:22:00.352ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1451, tv_nsec: 437619454 } })
66712024-12-21T06:22:00.352ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
66722024-12-21T06:22:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66732024-12-21T06:22:00.352ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 06:12:00.349818812 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
66742024-12-21T06:22:00.352ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.103946ms iteration = 9 status = {"expiration":"2024-12-21T06:12:00.349818812Z","pruned":[]}
66752024-12-21T06:22:00.353ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66762024-12-21T06:22:00.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66772024-12-21T06:22:00.354ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.209687ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66782024-12-21T06:22:00.355ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1451, tv_nsec: 440263227 } })
66792024-12-21T06:22:00.355ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
66802024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
66812024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66822024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66832024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
66842024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66852024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
66862024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
66872024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
66882024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
66892024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
66902024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
66912024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
66922024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66932024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
66942024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66952024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
66962024-12-21T06:22:00.355ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66972024-12-21T06:22:00.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66982024-12-21T06:22:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66992024-12-21T06:22:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
67002024-12-21T06:22:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
67012024-12-21T06:22:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67022024-12-21T06:22:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67032024-12-21T06:22:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67042024-12-21T06:22:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67052024-12-21T06:22:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67062024-12-21T06:22:00.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67072024-12-21T06:22:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67082024-12-21T06:22:00.357ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67092024-12-21T06:22:00.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67102024-12-21T06:22:00.359ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67112024-12-21T06:22:00.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67122024-12-21T06:22:00.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67132024-12-21T06:22:00.359ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67142024-12-21T06:22:00.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67152024-12-21T06:22:00.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67162024-12-21T06:22:00.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67172024-12-21T06:22:00.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67182024-12-21T06:22:00.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67192024-12-21T06:22:00.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
67202024-12-21T06:22:00.361ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67212024-12-21T06:22:00.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67222024-12-21T06:22:00.362ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67232024-12-21T06:22:00.364ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67242024-12-21T06:22:00.365ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67252024-12-21T06:22:00.365ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67262024-12-21T06:22:00.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67272024-12-21T06:22:00.365ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67282024-12-21T06:22:00.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67292024-12-21T06:22:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67302024-12-21T06:22:00.370ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.212745ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
67312024-12-21T06:22:00.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67322024-12-21T06:22:00.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67332024-12-21T06:22:00.374ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67342024-12-21T06:22:00.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67352024-12-21T06:22:00.376ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
67362024-12-21T06:22:00.376ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
67372024-12-21T06:22:00.376ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.19371ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
67382024-12-21T06:22:00.377ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67392024-12-21T06:22:00.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67402024-12-21T06:22:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67412024-12-21T06:22:00.378ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1451, tv_nsec: 463265445 } })
67422024-12-21T06:22:00.378ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
67432024-12-21T06:22:00.379ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67442024-12-21T06:22:00.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
67452024-12-21T06:22:00.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67462024-12-21T06:22:00.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67472024-12-21T06:22:00.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67482024-12-21T06:22:00.381ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67492024-12-21T06:22:00.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67502024-12-21T06:22:00.396ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67512024-12-21T06:22:00.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67522024-12-21T06:22:00.403ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
67532024-12-21T06:22:00.403ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.648738ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
67542024-12-21T06:22:00.410ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67552024-12-21T06:22:00.410ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
67562024-12-21T06:22:00.410ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67572024-12-21T06:22:00.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67582024-12-21T06:22:00.414ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67592024-12-21T06:22:00.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67602024-12-21T06:22:00.417ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67612024-12-21T06:22:00.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67622024-12-21T06:22:00.418ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
67632024-12-21T06:22:00.418ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
67642024-12-21T06:22:00.418ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 67.902064ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
67652024-12-21T06:22:00.418ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67662024-12-21T06:22:00.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67672024-12-21T06:22:00.419ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67682024-12-21T06:22:00.420ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67692024-12-21T06:22:00.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67702024-12-21T06:22:00.420ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67712024-12-21T06:22:00.421ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
67722024-12-21T06:22:00.421ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
67732024-12-21T06:22:00.421ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
67742024-12-21T06:22:00.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67752024-12-21T06:22:00.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67762024-12-21T06:22:00.421ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67772024-12-21T06:22:00.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67782024-12-21T06:22:00.423ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67792024-12-21T06:22:00.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67802024-12-21T06:22:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67812024-12-21T06:22:00.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
67822024-12-21T06:22:00.425ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67832024-12-21T06:22:00.425ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67842024-12-21T06:22:00.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67852024-12-21T06:22:00.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.58036ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
67862024-12-21T06:22:00.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.116974ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
67872024-12-21T06:22:00.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67882024-12-21T06:22:00.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67892024-12-21T06:22:00.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67902024-12-21T06:22:00.428ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67912024-12-21T06:22:00.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67922024-12-21T06:22:00.430ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.081761ms iteration = 17 status = 0
67932024-12-21T06:22:00.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.936998ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67942024-12-21T06:22:00.430ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67952024-12-21T06:22:00.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
67962024-12-21T06:22:00.433ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67972024-12-21T06:22:00.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67982024-12-21T06:22:00.434ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67992024-12-21T06:22:00.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68002024-12-21T06:22:00.437ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68012024-12-21T06:22:00.438ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68022024-12-21T06:22:00.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68032024-12-21T06:22:00.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68042024-12-21T06:22:00.445ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68052024-12-21T06:22:00.445ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68062024-12-21T06:22:00.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68072024-12-21T06:22:00.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68082024-12-21T06:22:00.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 96.150067ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68092024-12-21T06:22:00.452ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68102024-12-21T06:22:00.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68112024-12-21T06:22:00.453ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 102.871563ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68122024-12-21T06:22:00.454ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
68132024-12-21T06:22:00.454ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
68142024-12-21T06:22:00.454ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
68152024-12-21T06:22:00.454ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68162024-12-21T06:22:00.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68172024-12-21T06:22:00.463ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68182024-12-21T06:22:00.465ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68192024-12-21T06:22:00.465ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68202024-12-21T06:22:00.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68212024-12-21T06:22:00.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68222024-12-21T06:22:00.469ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68232024-12-21T06:22:00.470ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 119.463344ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68242024-12-21T06:22:00.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68252024-12-21T06:22:00.472ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68262024-12-21T06:22:00.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68272024-12-21T06:22:00.474ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
68282024-12-21T06:22:00.474ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 0 version = 2
68292024-12-21T06:22:00.474ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68302024-12-21T06:22:00.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68312024-12-21T06:22:00.476ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68322024-12-21T06:22:00.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68332024-12-21T06:22:00.479ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68342024-12-21T06:22:00.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68352024-12-21T06:22:00.481ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 1 version = 2
68362024-12-21T06:22:00.484ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
68372024-12-21T06:22:00.484ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 06:14:08.776888 UTC dns_group = external generation = 2
68382024-12-21T06:22:00.484ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 131.737193ms iteration = 10 status = {"generation":2}
68392024-12-21T06:22:00.487ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T06:13:58.796551Z, time_modified: 2024-12-21T06:13:58.796551Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }) }
68402024-12-21T06:22:00.488ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 137.070052ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]}},"default_endpoint":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
68412024-12-21T06:22:00.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 137.668388ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
68422024-12-21T06:22:00.493ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68432024-12-21T06:22:00.493ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68442024-12-21T06:22:00.493ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 143.059718ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68452024-12-21T06:22:00.494ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
68462024-12-21T06:22:00.496ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
68472024-12-21T06:22:00.496ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 145.573578ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
68482024-12-21T06:22:00.499ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68492024-12-21T06:22:00.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68502024-12-21T06:22:00.501ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68512024-12-21T06:22:00.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68522024-12-21T06:22:00.504ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68532024-12-21T06:22:00.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68542024-12-21T06:22:00.515ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
68552024-12-21T06:22:00.515ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68562024-12-21T06:22:00.515ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44b4b774-e1f5-40fd-9c57-53e28a7f80a8", "content-length": "26", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} })
68572024-12-21T06:22:00.515ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68582024-12-21T06:22:00.516ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68592024-12-21T06:22:00.517ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
68602024-12-21T06:22:00.518ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 168.438651ms iteration = 20 status = {"physical_disks_added":0}
68612024-12-21T06:22:00.522ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
68622024-12-21T06:22:00.522ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68632024-12-21T06:22:00.522ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f83e9e6-f93f-4784-be9a-7ebcd1f39bd0", "content-length": "26", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} })
68642024-12-21T06:22:00.522ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68652024-12-21T06:22:00.523ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68662024-12-21T06:22:00.532ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
68672024-12-21T06:22:00.532ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
68682024-12-21T06:22:00.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68692024-12-21T06:22:00.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68702024-12-21T06:22:00.541ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
68712024-12-21T06:22:00.541ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68722024-12-21T06:22:00.541ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6045c9b3-cd3b-44b3-b9ee-d66c32049075", "content-length": "26", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} })
68732024-12-21T06:22:00.541ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68742024-12-21T06:22:00.543ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
68752024-12-21T06:22:00.718ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68762024-12-21T06:22:00.718ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bc8318d-11f0-4d4c-a632-6e586aa0e158", "content-length": "1", "date": "Sat, 21 Dec 2024 06:21:59 GMT"} })
68772024-12-21T06:22:00.719ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68782024-12-21T06:22:00.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68792024-12-21T06:22:00.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3b85ac48-51c0-42e7-8a64-3f54b286948b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
68802024-12-21T06:22:00.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3b85ac48-51c0-42e7-8a64-3f54b286948b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
68812024-12-21T06:22:00.768ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
68822024-12-21T06:22:00.782ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
68832024-12-21T06:22:00.782ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68842024-12-21T06:22:00.782ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5624a135-041a-40b5-88fd-32afdbb6fdd4", "content-length": "372", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} })
68852024-12-21T06:22:00.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68862024-12-21T06:22:00.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68872024-12-21T06:22:00.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68882024-12-21T06:22:00.785ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 435.822608ms iteration = 17 status = null
68892024-12-21T06:22:00.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58754 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3b85ac48-51c0-42e7-8a64-3f54b286948b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
68902024-12-21T06:22:00.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68912024-12-21T06:22:00.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68922024-12-21T06:22:00.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68932024-12-21T06:22:00.792ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
68942024-12-21T06:22:00.793ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
68952024-12-21T06:22:00.793ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 06:14:07.931887 UTC dns_group = internal generation = 1
68962024-12-21T06:22:00.793ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 443.211882ms iteration = 10 status = {"generation":1}
68972024-12-21T06:22:00.810ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
68982024-12-21T06:22:00.810ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "dc26213c-da63-47ff-8e3b-d3379f7167e9", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
68992024-12-21T06:22:00.810ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69002024-12-21T06:22:00.812ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5bd4677a-8ea0-4d04-b752-1888b48ccbce", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69012024-12-21T06:22:00.812ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69022024-12-21T06:22:00.814ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69032024-12-21T06:22:00.814ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 464.196034ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
69042024-12-21T06:22:00.828ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
69052024-12-21T06:22:00.828ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69062024-12-21T06:22:00.828ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4c1ee0b4-f2a2-4c76-b46a-1d1f73ff2754", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} })
69072024-12-21T06:22:00.828ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69082024-12-21T06:22:00.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69092024-12-21T06:22:00.830ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 480.905818ms iteration = 17 status = {}
69102024-12-21T06:22:00.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69112024-12-21T06:22:00.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69122024-12-21T06:22:00.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69132024-12-21T06:22:00.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69142024-12-21T06:22:00.837ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
69152024-12-21T06:22:00.837ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69162024-12-21T06:22:00.837ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2582a624-b39e-4573-8a5d-176cf11f9e38", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} })
69172024-12-21T06:22:00.839ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 483.664404ms iteration = 18 status = {}
69182024-12-21T06:22:00.873ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
69192024-12-21T06:22:00.874ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a0eff975-8191-464d-90d0-f4521cf27287", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
69202024-12-21T06:22:00.874ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
69212024-12-21T06:22:00.876ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f3953f40-4e29-46bb-8750-29bd9d197961", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
69222024-12-21T06:22:00.876ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
69232024-12-21T06:22:00.876ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69242024-12-21T06:22:00.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69252024-12-21T06:22:00.877ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "12015fe1-ab73-4115-a4f4-0e57a4720bc8", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
69262024-12-21T06:22:00.877ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
69272024-12-21T06:22:00.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69282024-12-21T06:22:00.879ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
69292024-12-21T06:22:00.879ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 529.686321ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
69302024-12-21T06:22:00.880ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69312024-12-21T06:22:00.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69322024-12-21T06:22:00.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69332024-12-21T06:22:00.891ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69342024-12-21T06:22:00.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69352024-12-21T06:22:00.893ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
69362024-12-21T06:22:00.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69372024-12-21T06:22:00.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69382024-12-21T06:22:00.903ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
69392024-12-21T06:22:00.903ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "15ad6b1e-c23c-436a-b07a-0bfaee55abbc", "content-length": "134", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} })
69402024-12-21T06:22:00.903ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
69412024-12-21T06:22:00.903ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
69422024-12-21T06:22:00.903ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69432024-12-21T06:22:00.903ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69442024-12-21T06:22:00.903ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69452024-12-21T06:22:00.903ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69462024-12-21T06:22:00.903ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69472024-12-21T06:22:00.903ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69482024-12-21T06:22:00.903ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69492024-12-21T06:22:00.903ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69502024-12-21T06:22:00.903ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
69512024-12-21T06:22:00.903ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69522024-12-21T06:22:00.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69532024-12-21T06:22:00.905ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
69542024-12-21T06:22:00.905ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e0c9ed0-6caf-4862-8bf2-5aa114b27a90", "content-length": "2", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} })
69552024-12-21T06:22:00.905ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69562024-12-21T06:22:00.905ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b33c0f7f-6ec6-41f6-834e-957d050dbced", "content-length": "52", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} })
69572024-12-21T06:22:00.905ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
69582024-12-21T06:22:00.905ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69592024-12-21T06:22:00.908ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69602024-12-21T06:22:00.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
69612024-12-21T06:22:00.910ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69622024-12-21T06:22:00.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69632024-12-21T06:22:00.994ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69642024-12-21T06:22:01.000ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "610bf1d4-54df-4b8f-b96c-7578dc00af31", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} })
69652024-12-21T06:22:01.000ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
69662024-12-21T06:22:01.000ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69672024-12-21T06:22:01.001ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7dc7de02-b300-4af2-bd28-9cc532e6350c", "content-length": "691", "date": "Sat, 21 Dec 2024 06:22:00 GMT"} })
69682024-12-21T06:22:01.001ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
69692024-12-21T06:22:01.001ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
69702024-12-21T06:22:01.001ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
69712024-12-21T06:22:01.001ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab5348fd-bd27-440e-a90c-9429943d0a8b", "content-length": "682", "date": "Sat, 21 Dec 2024 06:22:01 GMT"} })
69722024-12-21T06:22:01.001ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69732024-12-21T06:22:01.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69742024-12-21T06:22:01.002ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 651.52877ms iteration = 17 status = {}
69752024-12-21T06:22:01.005ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69762024-12-21T06:22:01.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69772024-12-21T06:22:01.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69782024-12-21T06:22:01.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69792024-12-21T06:22:01.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69802024-12-21T06:22:01.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69812024-12-21T06:22:01.018ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 668.409658ms iteration = 17 status = {}
69822024-12-21T06:22:01.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 63e08aed-2335-4283-8cdd-e656ff3ece1d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
69832024-12-21T06:22:01.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 63e08aed-2335-4283-8cdd-e656ff3ece1d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
69842024-12-21T06:22:01.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3009 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 63e08aed-2335-4283-8cdd-e656ff3ece1d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
69852024-12-21T06:22:01.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8eb840db-052a-4db3-8b0c-b8208c5514b3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
69862024-12-21T06:22:01.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8eb840db-052a-4db3-8b0c-b8208c5514b3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
69872024-12-21T06:22:01.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2929 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8eb840db-052a-4db3-8b0c-b8208c5514b3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
69882024-12-21T06:22:02.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d418ea9e-cf4d-403f-aed1-55d5d9e5575f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
69892024-12-21T06:22:02.829ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d418ea9e-cf4d-403f-aed1-55d5d9e5575f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
69902024-12-21T06:22:02.831ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d418ea9e-cf4d-403f-aed1-55d5d9e5575f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
69912024-12-21T06:22:03.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 634597d7-a9de-4393-ac63-e630ab192785 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
69922024-12-21T06:22:03.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 634597d7-a9de-4393-ac63-e630ab192785 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
69932024-12-21T06:22:03.853ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 634597d7-a9de-4393-ac63-e630ab192785 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
69942024-12-21T06:22:03.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1227 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = bb9da065-d50c-4c69-9aaa-2875a2edc1c3 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
69952024-12-21T06:22:04.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 61ea8002-eb52-4054-a47a-3ee4a296240e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
69962024-12-21T06:22:04.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 61ea8002-eb52-4054-a47a-3ee4a296240e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
69972024-12-21T06:22:04.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2598 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 61ea8002-eb52-4054-a47a-3ee4a296240e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
69982024-12-21T06:22:05.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1bcc4287-f8d2-4bbd-a02c-6982eabadad6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
69992024-12-21T06:22:05.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1bcc4287-f8d2-4bbd-a02c-6982eabadad6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70002024-12-21T06:22:05.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2944 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1bcc4287-f8d2-4bbd-a02c-6982eabadad6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70012024-12-21T06:22:06.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a3600592-b991-4a85-ad88-2243dffccbf8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70022024-12-21T06:22:06.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a3600592-b991-4a85-ad88-2243dffccbf8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70032024-12-21T06:22:06.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a3600592-b991-4a85-ad88-2243dffccbf8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70042024-12-21T06:22:07.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8416ff45-ce05-46ad-a1a2-d0f5fa230371 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70052024-12-21T06:22:07.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8416ff45-ce05-46ad-a1a2-d0f5fa230371 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70062024-12-21T06:22:07.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8416ff45-ce05-46ad-a1a2-d0f5fa230371 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70072024-12-21T06:22:08.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6827c056-9257-447c-8996-1ede738971dd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70082024-12-21T06:22:08.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6827c056-9257-447c-8996-1ede738971dd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70092024-12-21T06:22:08.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6827c056-9257-447c-8996-1ede738971dd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70102024-12-21T06:22:09.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3a833ee2-7a35-4261-8f2b-b9b82fd31369 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70112024-12-21T06:22:09.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3a833ee2-7a35-4261-8f2b-b9b82fd31369 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70122024-12-21T06:22:09.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3a833ee2-7a35-4261-8f2b-b9b82fd31369 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70132024-12-21T06:22:10.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
70142024-12-21T06:22:10.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70152024-12-21T06:22:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70162024-12-21T06:22:10.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
70172024-12-21T06:22:10.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70182024-12-21T06:22:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70192024-12-21T06:22:10.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70202024-12-21T06:22:10.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70212024-12-21T06:22:10.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70222024-12-21T06:22:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70232024-12-21T06:22:10.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70242024-12-21T06:22:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70252024-12-21T06:22:10.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70262024-12-21T06:22:10.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70272024-12-21T06:22:10.381ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.846625ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70282024-12-21T06:22:10.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70292024-12-21T06:22:10.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
70302024-12-21T06:22:10.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70312024-12-21T06:22:10.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70322024-12-21T06:22:10.398ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
70332024-12-21T06:22:10.398ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.499645ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
70342024-12-21T06:22:11.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 79e7703f-b392-49a1-8d6b-0d50cd897384 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70352024-12-21T06:22:11.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 79e7703f-b392-49a1-8d6b-0d50cd897384 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70362024-12-21T06:22:11.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 79e7703f-b392-49a1-8d6b-0d50cd897384 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70372024-12-21T06:22:12.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3112e3b7-22f6-4e43-80fa-67d7f50c1f49 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70382024-12-21T06:22:12.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3112e3b7-22f6-4e43-80fa-67d7f50c1f49 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70392024-12-21T06:22:12.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2663 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3112e3b7-22f6-4e43-80fa-67d7f50c1f49 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70402024-12-21T06:22:13.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 322e0ff5-4e3d-40ac-a7e2-9611b149ac13 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70412024-12-21T06:22:13.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 322e0ff5-4e3d-40ac-a7e2-9611b149ac13 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70422024-12-21T06:22:13.046ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 322e0ff5-4e3d-40ac-a7e2-9611b149ac13 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70432024-12-21T06:22:13.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 2df9d7ef-65c4-430a-975c-ef6d8c639f21 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
70442024-12-21T06:22:13.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 2df9d7ef-65c4-430a-975c-ef6d8c639f21 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
70452024-12-21T06:22:13.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 2df9d7ef-65c4-430a-975c-ef6d8c639f21 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
70462024-12-21T06:22:13.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = c7404db4-57f7-400f-acb8-8e335b2e00ed roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
70472024-12-21T06:22:13.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = c7404db4-57f7-400f-acb8-8e335b2e00ed resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
70482024-12-21T06:22:13.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = c7404db4-57f7-400f-acb8-8e335b2e00ed response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
70492024-12-21T06:22:13.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1570 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = d2124caa-bb1d-4691-8849-34360e1f9119 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
70502024-12-21T06:22:14.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bac68516-cb01-4609-92b9-f98fb81a2307 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70512024-12-21T06:22:14.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bac68516-cb01-4609-92b9-f98fb81a2307 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70522024-12-21T06:22:14.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bac68516-cb01-4609-92b9-f98fb81a2307 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70532024-12-21T06:22:15.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6ce69596-991c-4ce8-808c-36d5651cf705 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70542024-12-21T06:22:15.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6ce69596-991c-4ce8-808c-36d5651cf705 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70552024-12-21T06:22:15.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6ce69596-991c-4ce8-808c-36d5651cf705 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70562024-12-21T06:22:16.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f4edb7e5-a9e5-44a2-b3d9-1c940097d08d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70572024-12-21T06:22:16.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f4edb7e5-a9e5-44a2-b3d9-1c940097d08d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70582024-12-21T06:22:16.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f4edb7e5-a9e5-44a2-b3d9-1c940097d08d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70592024-12-21T06:22:17.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1cc742bc-d84d-4e70-aea1-5d8f62b5ba68 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70602024-12-21T06:22:17.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1cc742bc-d84d-4e70-aea1-5d8f62b5ba68 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70612024-12-21T06:22:17.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1cc742bc-d84d-4e70-aea1-5d8f62b5ba68 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70622024-12-21T06:22:18.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 01a64280-5d6f-4919-bae2-fe55a5d4301d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70632024-12-21T06:22:18.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 01a64280-5d6f-4919-bae2-fe55a5d4301d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70642024-12-21T06:22:18.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 01a64280-5d6f-4919-bae2-fe55a5d4301d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70652024-12-21T06:22:19.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3be23ffa-6c27-4147-b92c-8663c573ea2d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70662024-12-21T06:22:19.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3be23ffa-6c27-4147-b92c-8663c573ea2d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70672024-12-21T06:22:19.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3be23ffa-6c27-4147-b92c-8663c573ea2d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70682024-12-21T06:22:20.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8d05503e-9a6a-4e03-bc64-3408c50531fe roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70692024-12-21T06:22:20.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8d05503e-9a6a-4e03-bc64-3408c50531fe resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70702024-12-21T06:22:20.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8d05503e-9a6a-4e03-bc64-3408c50531fe response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70712024-12-21T06:22:20.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
70722024-12-21T06:22:20.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70732024-12-21T06:22:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70742024-12-21T06:22:20.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
70752024-12-21T06:22:20.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70762024-12-21T06:22:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70772024-12-21T06:22:20.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70782024-12-21T06:22:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70792024-12-21T06:22:20.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70802024-12-21T06:22:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70812024-12-21T06:22:20.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70822024-12-21T06:22:20.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70832024-12-21T06:22:20.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70842024-12-21T06:22:20.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
70852024-12-21T06:22:20.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70862024-12-21T06:22:20.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70872024-12-21T06:22:20.376ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
70882024-12-21T06:22:20.376ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.642659ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
70892024-12-21T06:22:20.385ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70902024-12-21T06:22:20.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70912024-12-21T06:22:20.420ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.640702ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70922024-12-21T06:22:21.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eee73634-d887-45c9-ab94-ea9faddca33f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70932024-12-21T06:22:21.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eee73634-d887-45c9-ab94-ea9faddca33f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70942024-12-21T06:22:21.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1551 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eee73634-d887-45c9-ab94-ea9faddca33f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70952024-12-21T06:22:22.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a8553194-e3f9-4cbe-833b-86cb1f4d836f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70962024-12-21T06:22:22.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a8553194-e3f9-4cbe-833b-86cb1f4d836f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70972024-12-21T06:22:22.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a8553194-e3f9-4cbe-833b-86cb1f4d836f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70982024-12-21T06:22:23.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 62260db4-b0c3-41b6-834f-4a92226c91df roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
70992024-12-21T06:22:23.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 62260db4-b0c3-41b6-834f-4a92226c91df resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71002024-12-21T06:22:23.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 62260db4-b0c3-41b6-834f-4a92226c91df response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71012024-12-21T06:22:23.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1380 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 7423febc-b9a0-4129-aa86-fd6847e2a1c7 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
71022024-12-21T06:22:24.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 75265ffc-2a69-4a85-82a8-055c4e211fbf roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71032024-12-21T06:22:24.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 75265ffc-2a69-4a85-82a8-055c4e211fbf resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71042024-12-21T06:22:24.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 75265ffc-2a69-4a85-82a8-055c4e211fbf response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71052024-12-21T06:22:25.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = be6b64a9-7b39-400b-b300-36dd1f49647d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71062024-12-21T06:22:25.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = be6b64a9-7b39-400b-b300-36dd1f49647d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71072024-12-21T06:22:25.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = be6b64a9-7b39-400b-b300-36dd1f49647d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71082024-12-21T06:22:26.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a3e5053e-c6d1-46df-b431-1dcaf347b7f9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71092024-12-21T06:22:26.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a3e5053e-c6d1-46df-b431-1dcaf347b7f9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71102024-12-21T06:22:26.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1766 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a3e5053e-c6d1-46df-b431-1dcaf347b7f9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71112024-12-21T06:22:27.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5cc41185-8e59-4b59-baa7-172644a4ec14 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71122024-12-21T06:22:27.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5cc41185-8e59-4b59-baa7-172644a4ec14 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71132024-12-21T06:22:27.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1778 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5cc41185-8e59-4b59-baa7-172644a4ec14 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71142024-12-21T06:22:28.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7025ba50-9c47-4408-bbd3-73b7bf472ffa roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71152024-12-21T06:22:28.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7025ba50-9c47-4408-bbd3-73b7bf472ffa resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71162024-12-21T06:22:28.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7025ba50-9c47-4408-bbd3-73b7bf472ffa response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71172024-12-21T06:22:28.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 6cf581a0-bacd-4705-ae93-4da093ea3cb5 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
71182024-12-21T06:22:28.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 6cf581a0-bacd-4705-ae93-4da093ea3cb5 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
71192024-12-21T06:22:28.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 6cf581a0-bacd-4705-ae93-4da093ea3cb5 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
71202024-12-21T06:22:28.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = cd0340b2-a859-45d1-bd41-6e87f6be1e1d roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
71212024-12-21T06:22:28.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = cd0340b2-a859-45d1-bd41-6e87f6be1e1d resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
71222024-12-21T06:22:28.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = cd0340b2-a859-45d1-bd41-6e87f6be1e1d response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
71232024-12-21T06:22:29.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ff807bf-d825-430e-8045-d6b41163f5e6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71242024-12-21T06:22:29.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ff807bf-d825-430e-8045-d6b41163f5e6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71252024-12-21T06:22:29.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2348 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ff807bf-d825-430e-8045-d6b41163f5e6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
71262024-12-21T06:22:30.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
71272024-12-21T06:22:30.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71282024-12-21T06:22:30.349ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
71292024-12-21T06:22:30.349ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
71302024-12-21T06:22:30.349ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
71312024-12-21T06:22:30.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
71322024-12-21T06:22:30.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71332024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71342024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71352024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71362024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
71372024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
71382024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71392024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71402024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
71412024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71422024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
71432024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71442024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
71452024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71462024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71472024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
71482024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71492024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
71502024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71512024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
71522024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71532024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71542024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71552024-12-21T06:22:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71562024-12-21T06:22:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71572024-12-21T06:22:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71582024-12-21T06:22:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71592024-12-21T06:22:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71602024-12-21T06:22:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71612024-12-21T06:22:30.352ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1481, tv_nsec: 437931843 } })
71622024-12-21T06:22:30.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71632024-12-21T06:22:30.352ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.349443ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71642024-12-21T06:22:30.352ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
71652024-12-21T06:22:30.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1481, tv_nsec: 438508189 } })
71662024-12-21T06:22:30.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
71672024-12-21T06:22:30.354ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71682024-12-21T06:22:30.354ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71692024-12-21T06:22:30.354ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71702024-12-21T06:22:30.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71712024-12-21T06:22:30.354ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71722024-12-21T06:22:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71732024-12-21T06:22:30.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71742024-12-21T06:22:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71752024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
71762024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
71772024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71782024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
71792024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
71802024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
71812024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
71822024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71832024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
71842024-12-21T06:22:30.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
71852024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71862024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71872024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
71882024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71892024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71902024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71912024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71922024-12-21T06:22:30.356ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71932024-12-21T06:22:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71942024-12-21T06:22:30.357ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71952024-12-21T06:22:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71962024-12-21T06:22:30.358ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71972024-12-21T06:22:30.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71982024-12-21T06:22:30.358ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71992024-12-21T06:22:30.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72002024-12-21T06:22:30.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72012024-12-21T06:22:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72022024-12-21T06:22:30.360ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72032024-12-21T06:22:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72042024-12-21T06:22:30.362ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.570662ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
72052024-12-21T06:22:30.363ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72062024-12-21T06:22:30.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72072024-12-21T06:22:30.364ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72082024-12-21T06:22:30.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72092024-12-21T06:22:30.396ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72102024-12-21T06:22:30.399ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72112024-12-21T06:22:30.399ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72122024-12-21T06:22:30.399ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72132024-12-21T06:22:30.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72142024-12-21T06:22:30.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72152024-12-21T06:22:30.400ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72162024-12-21T06:22:30.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72172024-12-21T06:22:30.402ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.429187ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72182024-12-21T06:22:30.402ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.422568ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
72192024-12-21T06:22:30.402ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72202024-12-21T06:22:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72212024-12-21T06:22:30.404ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1481, tv_nsec: 489312968 } })
72222024-12-21T06:22:30.404ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
72232024-12-21T06:22:30.405ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72242024-12-21T06:22:30.405ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.199571ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72252024-12-21T06:22:30.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72262024-12-21T06:22:30.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72272024-12-21T06:22:30.407ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72282024-12-21T06:22:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72292024-12-21T06:22:30.408ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72302024-12-21T06:22:30.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72312024-12-21T06:22:30.409ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72322024-12-21T06:22:30.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72332024-12-21T06:22:30.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72342024-12-21T06:22:30.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 37713c73-342b-4a58-816b-2bc18322d7f7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
72352024-12-21T06:22:30.410ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72362024-12-21T06:22:30.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72372024-12-21T06:22:30.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 37713c73-342b-4a58-816b-2bc18322d7f7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
72382024-12-21T06:22:30.411ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72392024-12-21T06:22:30.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72402024-12-21T06:22:30.412ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
72412024-12-21T06:22:30.412ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72422024-12-21T06:22:30.412ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1be90e10-a0e6-483a-bd7e-9099422d0079", "content-length": "26", "date": "Sat, 21 Dec 2024 06:22:30 GMT"} })
72432024-12-21T06:22:30.412ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72442024-12-21T06:22:30.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72452024-12-21T06:22:30.413ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 57.292909ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72462024-12-21T06:22:30.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2862 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 37713c73-342b-4a58-816b-2bc18322d7f7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
72472024-12-21T06:22:30.415ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72482024-12-21T06:22:30.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
72492024-12-21T06:22:30.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72502024-12-21T06:22:30.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72512024-12-21T06:22:30.418ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
72522024-12-21T06:22:30.418ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.753259ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
72532024-12-21T06:22:30.418ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72542024-12-21T06:22:30.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72552024-12-21T06:22:30.425ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
72562024-12-21T06:22:30.425ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72572024-12-21T06:22:30.425ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec017b0f-1032-440a-8acd-f32693bd81f8", "content-length": "26", "date": "Sat, 21 Dec 2024 06:22:30 GMT"} })
72582024-12-21T06:22:30.425ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72592024-12-21T06:22:30.426ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72602024-12-21T06:22:30.427ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72612024-12-21T06:22:30.427ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
72622024-12-21T06:22:30.427ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.316242ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
72632024-12-21T06:22:30.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72642024-12-21T06:22:30.428ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72652024-12-21T06:22:30.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72662024-12-21T06:22:30.436ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72672024-12-21T06:22:30.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72682024-12-21T06:22:30.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72692024-12-21T06:22:30.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72702024-12-21T06:22:30.440ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72712024-12-21T06:22:30.440ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72722024-12-21T06:22:30.440ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 89.611935ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
72732024-12-21T06:22:30.444ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72742024-12-21T06:22:30.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72752024-12-21T06:22:30.472ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 121.52386ms iteration = 21 status = {"physical_disks_added":0}
72762024-12-21T06:22:30.474ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72772024-12-21T06:22:30.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
72782024-12-21T06:22:30.477ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72792024-12-21T06:22:30.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72802024-12-21T06:22:30.479ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 129.036749ms iteration = 18 status = 0
72812024-12-21T06:22:30.481ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 125.47859ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
72822024-12-21T06:22:30.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72832024-12-21T06:22:30.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72842024-12-21T06:22:30.519ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72852024-12-21T06:22:30.519ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ecfa3c8-c14b-47ec-883c-84ae369db650", "content-length": "1", "date": "Sat, 21 Dec 2024 06:22:30 GMT"} })
72862024-12-21T06:22:30.521ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72872024-12-21T06:22:30.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72882024-12-21T06:22:30.577ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72892024-12-21T06:22:30.577ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72902024-12-21T06:22:30.578ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "788db585-5f80-42a6-8eee-ed71161ce56e", "content-length": "372", "date": "Sat, 21 Dec 2024 06:22:30 GMT"} })
72912024-12-21T06:22:30.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72922024-12-21T06:22:30.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72932024-12-21T06:22:30.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72942024-12-21T06:22:30.579ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 230.191154ms iteration = 18 status = null
72952024-12-21T06:22:30.580ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72962024-12-21T06:22:30.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72972024-12-21T06:22:30.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72982024-12-21T06:22:30.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72992024-12-21T06:22:30.583ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
73002024-12-21T06:22:30.583ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73012024-12-21T06:22:30.583ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf350b95-8002-4899-8324-c775b3817021", "content-length": "26", "date": "Sat, 21 Dec 2024 06:22:30 GMT"} })
73022024-12-21T06:22:30.583ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73032024-12-21T06:22:30.584ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73042024-12-21T06:22:30.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73052024-12-21T06:22:30.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73062024-12-21T06:22:30.585ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
73072024-12-21T06:22:30.600ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 251.087614ms iteration = 18 status = {}
73082024-12-21T06:22:30.621ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
73092024-12-21T06:22:30.621ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73102024-12-21T06:22:30.621ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b25ffb8e-636e-4962-8c70-9d701c5899aa", "date": "Sat, 21 Dec 2024 06:22:30 GMT"} })
73112024-12-21T06:22:30.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73122024-12-21T06:22:30.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73132024-12-21T06:22:30.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73142024-12-21T06:22:30.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73152024-12-21T06:22:30.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73162024-12-21T06:22:30.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73172024-12-21T06:22:30.629ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
73182024-12-21T06:22:30.629ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73192024-12-21T06:22:30.630ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1389b717-bc84-4379-8838-673e81186040", "date": "Sat, 21 Dec 2024 06:22:30 GMT"} })
73202024-12-21T06:22:30.632ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 276.21539ms iteration = 19 status = {}
73212024-12-21T06:22:30.655ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
73222024-12-21T06:22:30.655ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a39c9f55-bc38-4178-b8d5-0f77f6c8601b", "content-length": "691", "date": "Sat, 21 Dec 2024 06:22:30 GMT"} })
73232024-12-21T06:22:30.655ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
73242024-12-21T06:22:30.655ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
73252024-12-21T06:22:30.655ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
73262024-12-21T06:22:30.656ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 306.226613ms iteration = 18 status = {}
73272024-12-21T06:22:30.712ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73282024-12-21T06:22:30.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73292024-12-21T06:22:30.714ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
73302024-12-21T06:22:30.714ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73312024-12-21T06:22:30.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73322024-12-21T06:22:30.723ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
73332024-12-21T06:22:30.724ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3e1607f-d14e-4ac3-afe9-61eb5cb30ae4", "content-length": "134", "date": "Sat, 21 Dec 2024 06:22:30 GMT"} })
73342024-12-21T06:22:30.724ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
73352024-12-21T06:22:30.724ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
73362024-12-21T06:22:30.724ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
73372024-12-21T06:22:30.724ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73382024-12-21T06:22:30.724ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73392024-12-21T06:22:30.724ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73402024-12-21T06:22:30.724ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73412024-12-21T06:22:30.724ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73422024-12-21T06:22:30.724ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
73432024-12-21T06:22:30.724ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
73442024-12-21T06:22:30.724ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
73452024-12-21T06:22:30.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73462024-12-21T06:22:30.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73472024-12-21T06:22:30.727ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
73482024-12-21T06:22:30.727ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f11dced-df5a-42fb-9be2-51ace93d1f8f", "content-length": "2", "date": "Sat, 21 Dec 2024 06:22:30 GMT"} })
73492024-12-21T06:22:30.727ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
73502024-12-21T06:22:30.727ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ca20c5e-146f-4513-b5b4-3eac35be7834", "content-length": "52", "date": "Sat, 21 Dec 2024 06:22:30 GMT"} })
73512024-12-21T06:22:30.727ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
73522024-12-21T06:22:30.727ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
73532024-12-21T06:22:30.815ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b1c398b4-b25d-43e8-a1e5-42486a034bc2", "date": "Sat, 21 Dec 2024 06:22:30 GMT"} })
73542024-12-21T06:22:30.815ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
73552024-12-21T06:22:30.815ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
73562024-12-21T06:22:30.816ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "17741b46-33c1-4c68-b0c9-5292036959b3", "content-length": "682", "date": "Sat, 21 Dec 2024 06:22:30 GMT"} })
73572024-12-21T06:22:30.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73582024-12-21T06:22:30.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73592024-12-21T06:22:30.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73602024-12-21T06:22:30.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73612024-12-21T06:22:30.825ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73622024-12-21T06:22:30.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73632024-12-21T06:22:30.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73642024-12-21T06:22:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73652024-12-21T06:22:30.835ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 484.766305ms iteration = 18 status = {}
73662024-12-21T06:22:31.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = c8fe61aa-19ec-4626-bc9c-16430d795d96 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
73672024-12-21T06:22:31.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = c8fe61aa-19ec-4626-bc9c-16430d795d96 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
73682024-12-21T06:22:31.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2826 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = c8fe61aa-19ec-4626-bc9c-16430d795d96 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
73692024-12-21T06:22:31.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5c31ff1e-78f4-4afb-b012-1425a055f674 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73702024-12-21T06:22:31.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5c31ff1e-78f4-4afb-b012-1425a055f674 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73712024-12-21T06:22:31.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5c31ff1e-78f4-4afb-b012-1425a055f674 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73722024-12-21T06:22:32.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f24e334e-4a19-46ff-8345-8662ee8fcbeb roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73732024-12-21T06:22:32.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f24e334e-4a19-46ff-8345-8662ee8fcbeb resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73742024-12-21T06:22:32.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f24e334e-4a19-46ff-8345-8662ee8fcbeb response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73752024-12-21T06:22:33.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3666485c-f2fb-4843-937a-2205159533a1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73762024-12-21T06:22:33.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3666485c-f2fb-4843-937a-2205159533a1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73772024-12-21T06:22:33.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3666485c-f2fb-4843-937a-2205159533a1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73782024-12-21T06:22:33.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1531 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 24e1bf37-c394-4503-842d-4accd2cabbfb response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
73792024-12-21T06:22:34.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 474d528b-0182-4a0c-93ca-c723bc3eb87a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73802024-12-21T06:22:34.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 474d528b-0182-4a0c-93ca-c723bc3eb87a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73812024-12-21T06:22:34.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 474d528b-0182-4a0c-93ca-c723bc3eb87a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73822024-12-21T06:22:35.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 56ee827f-0243-4ab1-93e7-70f9829e412a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73832024-12-21T06:22:35.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 56ee827f-0243-4ab1-93e7-70f9829e412a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73842024-12-21T06:22:35.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 56ee827f-0243-4ab1-93e7-70f9829e412a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73852024-12-21T06:22:36.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5d817955-0d67-4dfb-b9d5-df1d7290a4a7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73862024-12-21T06:22:36.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5d817955-0d67-4dfb-b9d5-df1d7290a4a7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73872024-12-21T06:22:36.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5d817955-0d67-4dfb-b9d5-df1d7290a4a7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73882024-12-21T06:22:37.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ea53e5a8-b92e-4db8-ab75-2901d6510f8a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73892024-12-21T06:22:37.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ea53e5a8-b92e-4db8-ab75-2901d6510f8a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73902024-12-21T06:22:37.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ea53e5a8-b92e-4db8-ab75-2901d6510f8a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73912024-12-21T06:22:38.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 744e90c8-0b5b-4cf7-8bd4-242c70d31555 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73922024-12-21T06:22:38.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 744e90c8-0b5b-4cf7-8bd4-242c70d31555 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73932024-12-21T06:22:38.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 744e90c8-0b5b-4cf7-8bd4-242c70d31555 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73942024-12-21T06:22:39.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1a7a4277-591e-4929-be99-a9573b13e4bd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73952024-12-21T06:22:39.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1a7a4277-591e-4929-be99-a9573b13e4bd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73962024-12-21T06:22:39.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1a7a4277-591e-4929-be99-a9573b13e4bd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
73972024-12-21T06:22:40.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
73982024-12-21T06:22:40.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73992024-12-21T06:22:40.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74002024-12-21T06:22:40.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
74012024-12-21T06:22:40.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74022024-12-21T06:22:40.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74032024-12-21T06:22:40.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74042024-12-21T06:22:40.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74052024-12-21T06:22:40.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74062024-12-21T06:22:40.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74072024-12-21T06:22:40.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74082024-12-21T06:22:40.354ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.540598ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74092024-12-21T06:22:40.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74102024-12-21T06:22:40.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74112024-12-21T06:22:40.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74122024-12-21T06:22:40.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74132024-12-21T06:22:40.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
74142024-12-21T06:22:40.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74152024-12-21T06:22:40.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74162024-12-21T06:22:40.368ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
74172024-12-21T06:22:40.368ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.838392ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
74182024-12-21T06:22:40.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 40e970c1-251e-4754-bfa8-8dbcc288a8f6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74192024-12-21T06:22:40.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 40e970c1-251e-4754-bfa8-8dbcc288a8f6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74202024-12-21T06:22:40.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 40e970c1-251e-4754-bfa8-8dbcc288a8f6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74212024-12-21T06:22:41.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 93b78cbc-1205-4342-b6d4-3185147e38b1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74222024-12-21T06:22:41.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 93b78cbc-1205-4342-b6d4-3185147e38b1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74232024-12-21T06:22:41.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 93b78cbc-1205-4342-b6d4-3185147e38b1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74242024-12-21T06:22:42.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff9277c2-f692-4747-8afb-15a2beac4f80 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74252024-12-21T06:22:42.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff9277c2-f692-4747-8afb-15a2beac4f80 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74262024-12-21T06:22:42.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff9277c2-f692-4747-8afb-15a2beac4f80 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74272024-12-21T06:22:43.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 46e4b62a-83a1-4984-82b6-00262960a9ae roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74282024-12-21T06:22:43.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 46e4b62a-83a1-4984-82b6-00262960a9ae resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74292024-12-21T06:22:43.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 46e4b62a-83a1-4984-82b6-00262960a9ae response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74302024-12-21T06:22:43.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = f018b9b2-3ca6-4951-805a-d3ed61b80268 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
74312024-12-21T06:22:43.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = f018b9b2-3ca6-4951-805a-d3ed61b80268 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
74322024-12-21T06:22:43.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2976 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = f018b9b2-3ca6-4951-805a-d3ed61b80268 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
74332024-12-21T06:22:43.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = c5b443c5-436d-4984-a6d5-524f562f51ab roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
74342024-12-21T06:22:43.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = c5b443c5-436d-4984-a6d5-524f562f51ab resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
74352024-12-21T06:22:43.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = c5b443c5-436d-4984-a6d5-524f562f51ab response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
74362024-12-21T06:22:43.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1170 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 41557da8-c1d6-4975-90d2-ad7d20d01e37 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
74372024-12-21T06:22:44.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f8f7c414-b979-42e6-a146-98aaf0ac91d3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74382024-12-21T06:22:44.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f8f7c414-b979-42e6-a146-98aaf0ac91d3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74392024-12-21T06:22:44.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f8f7c414-b979-42e6-a146-98aaf0ac91d3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74402024-12-21T06:22:45.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ac9bc53b-731f-4f3c-bd82-a85d6035a076 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74412024-12-21T06:22:45.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ac9bc53b-731f-4f3c-bd82-a85d6035a076 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74422024-12-21T06:22:45.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ac9bc53b-731f-4f3c-bd82-a85d6035a076 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74432024-12-21T06:22:46.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b5a055f1-61af-4d1d-9048-50d7fb14bb99 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74442024-12-21T06:22:46.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b5a055f1-61af-4d1d-9048-50d7fb14bb99 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74452024-12-21T06:22:46.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b5a055f1-61af-4d1d-9048-50d7fb14bb99 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74462024-12-21T06:22:47.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 39300aca-f487-4043-a1fe-86305786a24f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74472024-12-21T06:22:47.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 39300aca-f487-4043-a1fe-86305786a24f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74482024-12-21T06:22:47.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 39300aca-f487-4043-a1fe-86305786a24f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74492024-12-21T06:22:48.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f58de305-e11a-423d-b4b7-00c156bec92c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74502024-12-21T06:22:48.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f58de305-e11a-423d-b4b7-00c156bec92c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74512024-12-21T06:22:48.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f58de305-e11a-423d-b4b7-00c156bec92c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74522024-12-21T06:22:49.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ea609d2e-aa93-4241-895e-3268cd8f5f4c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74532024-12-21T06:22:49.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ea609d2e-aa93-4241-895e-3268cd8f5f4c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74542024-12-21T06:22:49.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ea609d2e-aa93-4241-895e-3268cd8f5f4c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74552024-12-21T06:22:50.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
74562024-12-21T06:22:50.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74572024-12-21T06:22:50.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74582024-12-21T06:22:50.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
74592024-12-21T06:22:50.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74602024-12-21T06:22:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74612024-12-21T06:22:50.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74622024-12-21T06:22:50.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74632024-12-21T06:22:50.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74642024-12-21T06:22:50.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74652024-12-21T06:22:50.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74662024-12-21T06:22:50.353ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.62105ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74672024-12-21T06:22:50.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74682024-12-21T06:22:50.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74692024-12-21T06:22:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74702024-12-21T06:22:50.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74712024-12-21T06:22:50.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
74722024-12-21T06:22:50.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74732024-12-21T06:22:50.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74742024-12-21T06:22:50.368ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
74752024-12-21T06:22:50.368ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.907534ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
74762024-12-21T06:22:50.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 67323bf9-4fc0-4fad-a588-4e9b9212dcf8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74772024-12-21T06:22:50.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 67323bf9-4fc0-4fad-a588-4e9b9212dcf8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74782024-12-21T06:22:50.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 67323bf9-4fc0-4fad-a588-4e9b9212dcf8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74792024-12-21T06:22:51.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 70721c0f-f063-4b43-b285-69445945b765 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74802024-12-21T06:22:51.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 70721c0f-f063-4b43-b285-69445945b765 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74812024-12-21T06:22:51.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 70721c0f-f063-4b43-b285-69445945b765 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74822024-12-21T06:22:52.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4227b4b3-3442-41c3-9167-c9f36bb6033d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74832024-12-21T06:22:52.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4227b4b3-3442-41c3-9167-c9f36bb6033d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74842024-12-21T06:22:52.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4227b4b3-3442-41c3-9167-c9f36bb6033d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74852024-12-21T06:22:53.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 396ed0ae-978b-401f-8ea4-28f41b7fd532 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74862024-12-21T06:22:53.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 396ed0ae-978b-401f-8ea4-28f41b7fd532 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74872024-12-21T06:22:53.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 396ed0ae-978b-401f-8ea4-28f41b7fd532 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74882024-12-21T06:22:53.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1250 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = c4d62f43-6898-46ba-afc7-fdba30e95a9d response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
74892024-12-21T06:22:54.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2c9fc7ad-4591-4775-a6cc-f63be2922c72 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74902024-12-21T06:22:54.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2c9fc7ad-4591-4775-a6cc-f63be2922c72 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74912024-12-21T06:22:54.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2c9fc7ad-4591-4775-a6cc-f63be2922c72 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74922024-12-21T06:22:55.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e23bdbf-e8e5-43d4-9f44-441e7dbb2fc9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74932024-12-21T06:22:55.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e23bdbf-e8e5-43d4-9f44-441e7dbb2fc9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74942024-12-21T06:22:55.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e23bdbf-e8e5-43d4-9f44-441e7dbb2fc9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74952024-12-21T06:22:56.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6642df4-d95b-43c7-a85a-23fe3356d110 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74962024-12-21T06:22:56.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6642df4-d95b-43c7-a85a-23fe3356d110 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74972024-12-21T06:22:56.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6642df4-d95b-43c7-a85a-23fe3356d110 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74982024-12-21T06:22:57.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3d852f52-bc56-41d9-b37a-2ad42033f311 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
74992024-12-21T06:22:57.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3d852f52-bc56-41d9-b37a-2ad42033f311 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
75002024-12-21T06:22:57.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3d852f52-bc56-41d9-b37a-2ad42033f311 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
75012024-12-21T06:22:59.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fa121f4b-b0da-4300-a539-77858a187827 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
75022024-12-21T06:22:59.004ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fa121f4b-b0da-4300-a539-77858a187827 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
75032024-12-21T06:22:59.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fa121f4b-b0da-4300-a539-77858a187827 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
75042024-12-21T06:23:00.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8591cbe1-7769-4833-be01-e003fb8db538 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
75052024-12-21T06:23:00.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8591cbe1-7769-4833-be01-e003fb8db538 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
75062024-12-21T06:23:00.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8591cbe1-7769-4833-be01-e003fb8db538 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
75072024-12-21T06:23:00.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
75082024-12-21T06:23:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
75092024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75102024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
75112024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75122024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
75132024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75142024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
75152024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
75162024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
75172024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
75182024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75192024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
75202024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
75212024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
75222024-12-21T06:23:00.350ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 7c419228-2431-4394-af83-ea0457364b70
75232024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.741\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"7c419228-2431-4394-af83-ea0457364b70"}
75242024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
75252024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
75262024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
75272024-12-21T06:23:00.350ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 06:13:00.350155449 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
75282024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75292024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
75302024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
75312024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75322024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
75332024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75342024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
75352024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
75362024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
75372024-12-21T06:23:00.350ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
75382024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75392024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75402024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
75412024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75422024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
75432024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75442024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
75452024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
75462024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75472024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
75482024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75492024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
75502024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75512024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
75522024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
75532024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75542024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75552024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
75562024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75572024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75582024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75592024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75602024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75612024-12-21T06:23:00.350ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1511, tv_nsec: 436188374 } })
75622024-12-21T06:23:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
75632024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75642024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75652024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75662024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75672024-12-21T06:23:00.351ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("068965c6-3480-4953-b57e-dd969abb2a21.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("45c0a855-5592-491c-b7b3-470902319db2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1511, tv_nsec: 436422171 } })
75682024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
75692024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75702024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75712024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75722024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75732024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75742024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75752024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75762024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75772024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75782024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75792024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
75802024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.341718ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
75812024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75822024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75832024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75842024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
75852024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
75862024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75872024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.511842ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
75882024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
75892024-12-21T06:23:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75902024-12-21T06:23:00.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1511, tv_nsec: 438857998 } })
75912024-12-21T06:23:00.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
75922024-12-21T06:23:00.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75932024-12-21T06:23:00.354ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75942024-12-21T06:23:00.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1511, tv_nsec: 439828135 } })
75952024-12-21T06:23:00.354ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.68991ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75962024-12-21T06:23:00.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
75972024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75982024-12-21T06:23:00.355ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 06:13:00.350155449 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
75992024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
76002024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.613106ms iteration = 10 status = {"expiration":"2024-12-21T06:13:00.350155449Z","pruned":[]}
76012024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76022024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
76032024-12-21T06:23:00.355ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
76042024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76052024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
76062024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
76072024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
76082024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
76092024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
76102024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76112024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
76122024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
76132024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76142024-12-21T06:23:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
76152024-12-21T06:23:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76162024-12-21T06:23:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
76172024-12-21T06:23:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76182024-12-21T06:23:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
76192024-12-21T06:23:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76202024-12-21T06:23:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76212024-12-21T06:23:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
76222024-12-21T06:23:00.356ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76232024-12-21T06:23:00.356ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76242024-12-21T06:23:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76252024-12-21T06:23:00.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76262024-12-21T06:23:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76272024-12-21T06:23:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76282024-12-21T06:23:00.357ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76292024-12-21T06:23:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76302024-12-21T06:23:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76312024-12-21T06:23:00.358ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76322024-12-21T06:23:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76332024-12-21T06:23:00.358ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76342024-12-21T06:23:00.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76352024-12-21T06:23:00.360ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76362024-12-21T06:23:00.360ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76372024-12-21T06:23:00.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76382024-12-21T06:23:00.361ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76392024-12-21T06:23:00.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76402024-12-21T06:23:00.362ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76412024-12-21T06:23:00.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76422024-12-21T06:23:00.362ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76432024-12-21T06:23:00.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76442024-12-21T06:23:00.362ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76452024-12-21T06:23:00.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76462024-12-21T06:23:00.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76472024-12-21T06:23:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76482024-12-21T06:23:00.363ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76492024-12-21T06:23:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76502024-12-21T06:23:00.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
76512024-12-21T06:23:00.364ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
76522024-12-21T06:23:00.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
76532024-12-21T06:23:00.365ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76542024-12-21T06:23:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76552024-12-21T06:23:00.367ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76562024-12-21T06:23:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76572024-12-21T06:23:00.367ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76582024-12-21T06:23:00.367ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76592024-12-21T06:23:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76602024-12-21T06:23:00.369ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76612024-12-21T06:23:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76622024-12-21T06:23:00.369ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76632024-12-21T06:23:00.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76642024-12-21T06:23:00.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76652024-12-21T06:23:00.371ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76662024-12-21T06:23:00.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76672024-12-21T06:23:00.371ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76682024-12-21T06:23:00.371ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.106576ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
76692024-12-21T06:23:00.373ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
76702024-12-21T06:23:00.373ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
76712024-12-21T06:23:00.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
76722024-12-21T06:23:00.375ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 19.47783ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
76732024-12-21T06:23:00.375ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76742024-12-21T06:23:00.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76752024-12-21T06:23:00.377ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76762024-12-21T06:23:00.377ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76772024-12-21T06:23:00.377ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76782024-12-21T06:23:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76792024-12-21T06:23:00.378ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76802024-12-21T06:23:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76812024-12-21T06:23:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76822024-12-21T06:23:00.379ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1511, tv_nsec: 465019594 } })
76832024-12-21T06:23:00.379ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
76842024-12-21T06:23:00.380ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76852024-12-21T06:23:00.380ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76862024-12-21T06:23:00.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76872024-12-21T06:23:00.384ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76882024-12-21T06:23:00.384ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 33.987653ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76892024-12-21T06:23:00.385ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76902024-12-21T06:23:00.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76912024-12-21T06:23:00.387ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 37.040927ms iteration = 5 status = {"nsuccess":5}
76922024-12-21T06:23:00.387ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76932024-12-21T06:23:00.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76942024-12-21T06:23:00.388ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76952024-12-21T06:23:00.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76962024-12-21T06:23:00.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76972024-12-21T06:23:00.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
76982024-12-21T06:23:00.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76992024-12-21T06:23:00.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77002024-12-21T06:23:00.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77012024-12-21T06:23:00.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77022024-12-21T06:23:00.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77032024-12-21T06:23:00.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77042024-12-21T06:23:00.401ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77052024-12-21T06:23:00.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77062024-12-21T06:23:00.410ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77072024-12-21T06:23:00.410ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
77082024-12-21T06:23:00.410ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77092024-12-21T06:23:00.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77102024-12-21T06:23:00.411ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77112024-12-21T06:23:00.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77122024-12-21T06:23:00.412ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.37481ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77132024-12-21T06:23:00.413ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77142024-12-21T06:23:00.413ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
77152024-12-21T06:23:00.413ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77162024-12-21T06:23:00.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77172024-12-21T06:23:00.415ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
77182024-12-21T06:23:00.415ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.845346ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
77192024-12-21T06:23:00.415ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77202024-12-21T06:23:00.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77212024-12-21T06:23:00.417ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77222024-12-21T06:23:00.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77232024-12-21T06:23:00.418ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
77242024-12-21T06:23:00.418ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
77252024-12-21T06:23:00.418ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
77262024-12-21T06:23:00.418ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77272024-12-21T06:23:00.418ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
77282024-12-21T06:23:00.418ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
77292024-12-21T06:23:00.418ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.08705ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
77302024-12-21T06:23:00.418ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77312024-12-21T06:23:00.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77322024-12-21T06:23:00.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77332024-12-21T06:23:00.420ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 64.364885ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
77342024-12-21T06:23:00.420ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77352024-12-21T06:23:00.421ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77362024-12-21T06:23:00.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77372024-12-21T06:23:00.422ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
77382024-12-21T06:23:00.422ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
77392024-12-21T06:23:00.422ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 72.068809ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
77402024-12-21T06:23:00.422ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77412024-12-21T06:23:00.422ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77422024-12-21T06:23:00.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77432024-12-21T06:23:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77442024-12-21T06:23:00.424ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77452024-12-21T06:23:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77462024-12-21T06:23:00.425ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 69.381225ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
77472024-12-21T06:23:00.425ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
77482024-12-21T06:23:00.425ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77492024-12-21T06:23:00.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77502024-12-21T06:23:00.427ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77512024-12-21T06:23:00.428ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
77522024-12-21T06:23:00.428ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
77532024-12-21T06:23:00.428ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
77542024-12-21T06:23:00.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77552024-12-21T06:23:00.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77562024-12-21T06:23:00.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
77572024-12-21T06:23:00.430ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77582024-12-21T06:23:00.430ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.173405ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77592024-12-21T06:23:00.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77602024-12-21T06:23:00.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77612024-12-21T06:23:00.433ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.147406ms iteration = 19 status = 0
77622024-12-21T06:23:00.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77632024-12-21T06:23:00.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77642024-12-21T06:23:00.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77652024-12-21T06:23:00.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
77662024-12-21T06:23:00.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
77672024-12-21T06:23:00.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 91.967041ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77682024-12-21T06:23:00.464ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77692024-12-21T06:23:00.464ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77702024-12-21T06:23:00.464ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.520068ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77712024-12-21T06:23:00.465ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
77722024-12-21T06:23:00.465ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
77732024-12-21T06:23:00.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77742024-12-21T06:23:00.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77752024-12-21T06:23:00.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77762024-12-21T06:23:00.468ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
77772024-12-21T06:23:00.468ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 0 version = 2
77782024-12-21T06:23:00.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77792024-12-21T06:23:00.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77802024-12-21T06:23:00.468ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
77812024-12-21T06:23:00.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
77822024-12-21T06:23:00.469ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77832024-12-21T06:23:00.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
77842024-12-21T06:23:00.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
77852024-12-21T06:23:00.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
77862024-12-21T06:23:00.472ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
77872024-12-21T06:23:00.472ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
77882024-12-21T06:23:00.472ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 06:14:07.931887 UTC dns_group = internal generation = 1
77892024-12-21T06:23:00.472ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 122.674372ms iteration = 11 status = {"generation":1}
77902024-12-21T06:23:00.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
77912024-12-21T06:23:00.473ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
77922024-12-21T06:23:00.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
77932024-12-21T06:23:00.475ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 1 version = 2
77942024-12-21T06:23:00.475ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
77952024-12-21T06:23:00.475ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 06:14:08.776888 UTC dns_group = external generation = 2
77962024-12-21T06:23:00.475ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 125.543622ms iteration = 11 status = {"generation":2}
77972024-12-21T06:23:00.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77982024-12-21T06:23:00.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77992024-12-21T06:23:00.496ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
78002024-12-21T06:23:00.496ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
78012024-12-21T06:23:00.498ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
78022024-12-21T06:23:00.498ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78032024-12-21T06:23:00.498ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7b46353-5715-4824-b3ee-d1a7c0004f73", "content-length": "26", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} })
78042024-12-21T06:23:00.498ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78052024-12-21T06:23:00.499ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78062024-12-21T06:23:00.500ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78072024-12-21T06:23:00.501ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
78082024-12-21T06:23:00.501ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
78092024-12-21T06:23:00.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
78102024-12-21T06:23:00.509ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 158.99228ms iteration = 22 status = {"physical_disks_added":0}
78112024-12-21T06:23:00.538ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
78122024-12-21T06:23:00.539ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78132024-12-21T06:23:00.539ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5843fcff-1907-4ce1-a27f-804990d81018", "content-length": "26", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} })
78142024-12-21T06:23:00.539ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78152024-12-21T06:23:00.540ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78162024-12-21T06:23:00.541ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
78172024-12-21T06:23:00.541ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 191.481731ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
78182024-12-21T06:23:00.586ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
78192024-12-21T06:23:00.586ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78202024-12-21T06:23:00.586ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78212024-12-21T06:23:00.586ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1da937ee-178e-4bae-b179-6e9bbc740595", "content-length": "26", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} })
78222024-12-21T06:23:00.586ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78232024-12-21T06:23:00.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78242024-12-21T06:23:00.588ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
78252024-12-21T06:23:00.642ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
78262024-12-21T06:23:00.646ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
78272024-12-21T06:23:00.647ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ce306545-3f2d-474c-aaee-ac3d01114773", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78282024-12-21T06:23:00.647ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78292024-12-21T06:23:00.648ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7d08050e-1bfd-47b3-a957-6b14f72c44ea", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78302024-12-21T06:23:00.648ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78312024-12-21T06:23:00.649ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
78322024-12-21T06:23:00.649ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 299.749043ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
78332024-12-21T06:23:00.659ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
78342024-12-21T06:23:00.659ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78352024-12-21T06:23:00.660ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8fde29c-31f6-4faf-a03c-085aa7d4b51f", "content-length": "372", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} })
78362024-12-21T06:23:00.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78372024-12-21T06:23:00.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78382024-12-21T06:23:00.677ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 327.7503ms iteration = 19 status = {}
78392024-12-21T06:23:00.690ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78402024-12-21T06:23:00.692ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78412024-12-21T06:23:00.692ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78422024-12-21T06:23:00.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78432024-12-21T06:23:00.693ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T06:13:58.796551Z, time_modified: 2024-12-21T06:13:58.796551Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }) }
78442024-12-21T06:23:00.693ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 343.242349ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]}},"default_endpoint":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
78452024-12-21T06:23:00.700ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
78462024-12-21T06:23:00.700ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
78472024-12-21T06:23:00.700ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3adc90fd-6587-4079-a5f4-91bb0dac6af7", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} })
78482024-12-21T06:23:00.700ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78492024-12-21T06:23:00.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78502024-12-21T06:23:00.703ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78512024-12-21T06:23:00.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78522024-12-21T06:23:00.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78532024-12-21T06:23:00.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78542024-12-21T06:23:00.709ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
78552024-12-21T06:23:00.709ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78562024-12-21T06:23:00.710ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3a76d6b3-9699-41b0-9765-c9c623fccdc7", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} })
78572024-12-21T06:23:00.711ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 356.179719ms iteration = 20 status = {}
78582024-12-21T06:23:00.720ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78592024-12-21T06:23:00.722ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
78602024-12-21T06:23:00.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78612024-12-21T06:23:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78622024-12-21T06:23:00.756ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
78632024-12-21T06:23:00.757ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e6c23f05-6fcc-4cce-817c-7172c0985532", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
78642024-12-21T06:23:00.757ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
78652024-12-21T06:23:00.758ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e87e1f1d-5be1-4158-b224-0af4e78aca8d", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
78662024-12-21T06:23:00.758ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
78672024-12-21T06:23:00.760ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a44962ce-825c-4816-ba8e-fa104bf83c0a", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
78682024-12-21T06:23:00.760ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
78692024-12-21T06:23:00.762ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
78702024-12-21T06:23:00.762ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 412.647204ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
78712024-12-21T06:23:00.799ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78722024-12-21T06:23:00.799ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a90e3bce-a9c8-41c9-8c73-235dd7bee181", "content-length": "1", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} })
78732024-12-21T06:23:00.800ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78742024-12-21T06:23:00.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78752024-12-21T06:23:00.802ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 453.029094ms iteration = 19 status = null
78762024-12-21T06:23:00.809ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
78772024-12-21T06:23:00.809ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4f4f69d-4504-4bf2-9da4-25cc667b9a55", "content-length": "691", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} })
78782024-12-21T06:23:00.809ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
78792024-12-21T06:23:00.809ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
78802024-12-21T06:23:00.809ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
78812024-12-21T06:23:00.811ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 460.745328ms iteration = 19 status = {}
78822024-12-21T06:23:00.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78832024-12-21T06:23:00.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78842024-12-21T06:23:00.868ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
78852024-12-21T06:23:00.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78862024-12-21T06:23:00.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78872024-12-21T06:23:00.877ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
78882024-12-21T06:23:00.877ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "101e48bc-815f-4dc4-bf3d-265b0ebba40b", "content-length": "134", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} })
78892024-12-21T06:23:00.877ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
78902024-12-21T06:23:00.877ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
78912024-12-21T06:23:00.877ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
78922024-12-21T06:23:00.877ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
78932024-12-21T06:23:00.877ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78942024-12-21T06:23:00.877ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78952024-12-21T06:23:00.877ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78962024-12-21T06:23:00.877ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78972024-12-21T06:23:00.878ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
78982024-12-21T06:23:00.878ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
78992024-12-21T06:23:00.878ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
79002024-12-21T06:23:00.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79012024-12-21T06:23:00.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79022024-12-21T06:23:00.880ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
79032024-12-21T06:23:00.880ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e306636-da78-4824-8446-623717b685c4", "content-length": "2", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} })
79042024-12-21T06:23:00.880ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
79052024-12-21T06:23:00.880ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca747691-88f6-418f-a029-1130106ad5f1", "content-length": "52", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} })
79062024-12-21T06:23:00.880ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
79072024-12-21T06:23:00.880ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79082024-12-21T06:23:00.973ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "47a5b966-5538-487b-9544-d14357ca98a8", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} })
79092024-12-21T06:23:00.973ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
79102024-12-21T06:23:00.973ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
79112024-12-21T06:23:00.973ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "14beba01-67ec-439a-a97e-cc170878c072", "content-length": "682", "date": "Sat, 21 Dec 2024 06:23:00 GMT"} })
79122024-12-21T06:23:00.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79132024-12-21T06:23:00.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79142024-12-21T06:23:00.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79152024-12-21T06:23:00.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79162024-12-21T06:23:00.981ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79172024-12-21T06:23:00.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79182024-12-21T06:23:00.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79192024-12-21T06:23:00.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79202024-12-21T06:23:00.991ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 640.805543ms iteration = 19 status = {}
79212024-12-21T06:23:01.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3fd016cc-947a-4369-b872-fdc17ed4bbcf roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79222024-12-21T06:23:01.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3fd016cc-947a-4369-b872-fdc17ed4bbcf resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79232024-12-21T06:23:01.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3fd016cc-947a-4369-b872-fdc17ed4bbcf response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79242024-12-21T06:23:01.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = de55fe83-510f-42ea-9be0-9a48d0b7732a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
79252024-12-21T06:23:01.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = de55fe83-510f-42ea-9be0-9a48d0b7732a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
79262024-12-21T06:23:01.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = de55fe83-510f-42ea-9be0-9a48d0b7732a response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
79272024-12-21T06:23:02.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 53dd2f30-1b8a-4340-ab94-5325d5695b12 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79282024-12-21T06:23:02.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 53dd2f30-1b8a-4340-ab94-5325d5695b12 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79292024-12-21T06:23:02.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 53dd2f30-1b8a-4340-ab94-5325d5695b12 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79302024-12-21T06:23:03.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 795ea2b3-ba4c-4517-be04-3af614b58c8f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79312024-12-21T06:23:03.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 795ea2b3-ba4c-4517-be04-3af614b58c8f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79322024-12-21T06:23:03.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 795ea2b3-ba4c-4517-be04-3af614b58c8f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79332024-12-21T06:23:03.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1770 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = f997a782-e90d-4658-91a7-a3137afcb56e response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
79342024-12-21T06:23:04.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0fc4bcb9-2a03-42fc-aa0d-0df21f76509c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79352024-12-21T06:23:04.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0fc4bcb9-2a03-42fc-aa0d-0df21f76509c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79362024-12-21T06:23:04.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0fc4bcb9-2a03-42fc-aa0d-0df21f76509c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79372024-12-21T06:23:05.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b2adea61-be65-481b-873e-a4838e2b9738 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79382024-12-21T06:23:05.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b2adea61-be65-481b-873e-a4838e2b9738 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79392024-12-21T06:23:05.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b2adea61-be65-481b-873e-a4838e2b9738 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79402024-12-21T06:23:06.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6494253-bbdc-4869-bf8e-822995f3a1c8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79412024-12-21T06:23:06.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6494253-bbdc-4869-bf8e-822995f3a1c8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79422024-12-21T06:23:06.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2819 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6494253-bbdc-4869-bf8e-822995f3a1c8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79432024-12-21T06:23:07.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 069039f5-59e2-4922-9eb1-48956a7b900a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79442024-12-21T06:23:07.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 069039f5-59e2-4922-9eb1-48956a7b900a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79452024-12-21T06:23:07.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2399 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 069039f5-59e2-4922-9eb1-48956a7b900a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79462024-12-21T06:23:08.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 188caf5f-00f1-4f91-a55b-6edae4a8c84d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79472024-12-21T06:23:08.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 188caf5f-00f1-4f91-a55b-6edae4a8c84d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79482024-12-21T06:23:08.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 188caf5f-00f1-4f91-a55b-6edae4a8c84d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79492024-12-21T06:23:09.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8d582cbc-a6b5-4a6b-b432-b4422273868b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79502024-12-21T06:23:09.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8d582cbc-a6b5-4a6b-b432-b4422273868b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79512024-12-21T06:23:09.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8d582cbc-a6b5-4a6b-b432-b4422273868b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79522024-12-21T06:23:10.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 30af4cf8-ecac-4a3d-a50c-5af508114ded roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79532024-12-21T06:23:10.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 30af4cf8-ecac-4a3d-a50c-5af508114ded resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79542024-12-21T06:23:10.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1493 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 30af4cf8-ecac-4a3d-a50c-5af508114ded response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79552024-12-21T06:23:10.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
79562024-12-21T06:23:10.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79572024-12-21T06:23:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79582024-12-21T06:23:10.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
79592024-12-21T06:23:10.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79602024-12-21T06:23:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79612024-12-21T06:23:10.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79622024-12-21T06:23:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79632024-12-21T06:23:10.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79642024-12-21T06:23:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79652024-12-21T06:23:10.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79662024-12-21T06:23:10.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79672024-12-21T06:23:10.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79682024-12-21T06:23:10.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
79692024-12-21T06:23:10.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79702024-12-21T06:23:10.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79712024-12-21T06:23:10.372ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
79722024-12-21T06:23:10.372ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.882455ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
79732024-12-21T06:23:10.383ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79742024-12-21T06:23:10.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79752024-12-21T06:23:10.411ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.751736ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79762024-12-21T06:23:11.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1ac3ae76-0aaa-4ce4-95da-5f58af5262cc roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79772024-12-21T06:23:11.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1ac3ae76-0aaa-4ce4-95da-5f58af5262cc resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79782024-12-21T06:23:11.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1ac3ae76-0aaa-4ce4-95da-5f58af5262cc response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79792024-12-21T06:23:12.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 79e1553f-40e4-4c00-ba1e-091b9ef68790 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79802024-12-21T06:23:12.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 79e1553f-40e4-4c00-ba1e-091b9ef68790 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79812024-12-21T06:23:12.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 79e1553f-40e4-4c00-ba1e-091b9ef68790 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79822024-12-21T06:23:13.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 039ee732-e29d-4e80-bc80-c1923fec1d91 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79832024-12-21T06:23:13.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 039ee732-e29d-4e80-bc80-c1923fec1d91 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79842024-12-21T06:23:13.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 039ee732-e29d-4e80-bc80-c1923fec1d91 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79852024-12-21T06:23:13.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 28ee72a1-4f16-496e-8ec8-bb23bfb077d3 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
79862024-12-21T06:23:13.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 28ee72a1-4f16-496e-8ec8-bb23bfb077d3 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
79872024-12-21T06:23:13.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3073 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 28ee72a1-4f16-496e-8ec8-bb23bfb077d3 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
79882024-12-21T06:23:13.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = f945793f-7781-4213-b1b2-21263ef7528e roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
79892024-12-21T06:23:13.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = f945793f-7781-4213-b1b2-21263ef7528e resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
79902024-12-21T06:23:13.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = f945793f-7781-4213-b1b2-21263ef7528e response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
79912024-12-21T06:23:13.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1216 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 7e35a56d-6598-4640-b7ad-d1576c05bc26 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
79922024-12-21T06:23:14.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5d059451-7a4a-4031-a4a2-db502eae500e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79932024-12-21T06:23:14.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5d059451-7a4a-4031-a4a2-db502eae500e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79942024-12-21T06:23:14.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5d059451-7a4a-4031-a4a2-db502eae500e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79952024-12-21T06:23:15.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9ea04cc0-f41e-489f-9173-2012418ab0f7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79962024-12-21T06:23:15.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9ea04cc0-f41e-489f-9173-2012418ab0f7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79972024-12-21T06:23:15.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2069 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9ea04cc0-f41e-489f-9173-2012418ab0f7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79982024-12-21T06:23:16.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13f761c7-3e39-4b4a-b6d6-58078f9a1b4f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
79992024-12-21T06:23:16.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13f761c7-3e39-4b4a-b6d6-58078f9a1b4f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80002024-12-21T06:23:16.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2196 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13f761c7-3e39-4b4a-b6d6-58078f9a1b4f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80012024-12-21T06:23:17.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 67fffaaf-2390-4aad-b5d7-52329b7cc4dd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80022024-12-21T06:23:17.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 67fffaaf-2390-4aad-b5d7-52329b7cc4dd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80032024-12-21T06:23:17.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2046 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 67fffaaf-2390-4aad-b5d7-52329b7cc4dd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80042024-12-21T06:23:18.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 668f1193-8f1e-431a-805a-ae2942cd3a25 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80052024-12-21T06:23:18.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 668f1193-8f1e-431a-805a-ae2942cd3a25 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80062024-12-21T06:23:18.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 668f1193-8f1e-431a-805a-ae2942cd3a25 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80072024-12-21T06:23:19.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7a4c5b6d-0891-4d3e-aae2-9d1727a6df50 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80082024-12-21T06:23:19.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7a4c5b6d-0891-4d3e-aae2-9d1727a6df50 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80092024-12-21T06:23:19.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7a4c5b6d-0891-4d3e-aae2-9d1727a6df50 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80102024-12-21T06:23:20.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
80112024-12-21T06:23:20.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
80122024-12-21T06:23:20.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80132024-12-21T06:23:20.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80142024-12-21T06:23:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80152024-12-21T06:23:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80162024-12-21T06:23:20.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80172024-12-21T06:23:20.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80182024-12-21T06:23:20.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80192024-12-21T06:23:20.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80202024-12-21T06:23:20.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80212024-12-21T06:23:20.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80222024-12-21T06:23:20.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80232024-12-21T06:23:20.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
80242024-12-21T06:23:20.362ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80252024-12-21T06:23:20.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80262024-12-21T06:23:20.374ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
80272024-12-21T06:23:20.375ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.814368ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
80282024-12-21T06:23:20.382ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80292024-12-21T06:23:20.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80302024-12-21T06:23:20.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.969035ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80312024-12-21T06:23:20.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a8b2dd8-35cb-4330-9cd1-1fce204f02a0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80322024-12-21T06:23:20.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a8b2dd8-35cb-4330-9cd1-1fce204f02a0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80332024-12-21T06:23:20.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a8b2dd8-35cb-4330-9cd1-1fce204f02a0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80342024-12-21T06:23:21.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cc73f663-8d3e-4a81-a3a1-c94379dd6101 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80352024-12-21T06:23:21.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cc73f663-8d3e-4a81-a3a1-c94379dd6101 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80362024-12-21T06:23:21.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1552 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cc73f663-8d3e-4a81-a3a1-c94379dd6101 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80372024-12-21T06:23:22.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4e9ec240-41ad-47f5-a764-180867b0eaba roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80382024-12-21T06:23:22.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4e9ec240-41ad-47f5-a764-180867b0eaba resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80392024-12-21T06:23:22.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2546 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4e9ec240-41ad-47f5-a764-180867b0eaba response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80402024-12-21T06:23:23.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1d79c300-a195-450e-81f6-d8f25f3b3383 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80412024-12-21T06:23:23.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1d79c300-a195-450e-81f6-d8f25f3b3383 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80422024-12-21T06:23:23.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1d79c300-a195-450e-81f6-d8f25f3b3383 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80432024-12-21T06:23:23.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1193 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 80c53b6c-369b-4011-9a9c-849ff3a29ac9 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
80442024-12-21T06:23:24.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f981758c-5b00-4b8d-90fa-797518ce41c2 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80452024-12-21T06:23:24.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f981758c-5b00-4b8d-90fa-797518ce41c2 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80462024-12-21T06:23:24.552ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f981758c-5b00-4b8d-90fa-797518ce41c2 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80472024-12-21T06:23:25.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c96d9644-29ea-46d6-a388-3e6c56831d2e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80482024-12-21T06:23:25.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c96d9644-29ea-46d6-a388-3e6c56831d2e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80492024-12-21T06:23:25.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1840 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c96d9644-29ea-46d6-a388-3e6c56831d2e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80502024-12-21T06:23:26.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6b9a07cc-e84f-45d4-a70e-94946e1a3dd6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80512024-12-21T06:23:26.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6b9a07cc-e84f-45d4-a70e-94946e1a3dd6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80522024-12-21T06:23:26.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1738 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6b9a07cc-e84f-45d4-a70e-94946e1a3dd6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80532024-12-21T06:23:27.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 86a7fbee-2ac2-4666-ab4d-102bc675fe37 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80542024-12-21T06:23:27.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 86a7fbee-2ac2-4666-ab4d-102bc675fe37 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80552024-12-21T06:23:27.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3602 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 86a7fbee-2ac2-4666-ab4d-102bc675fe37 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80562024-12-21T06:23:28.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 692a43bf-df66-4926-a4bb-35446e79b93a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80572024-12-21T06:23:28.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 692a43bf-df66-4926-a4bb-35446e79b93a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80582024-12-21T06:23:28.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 692a43bf-df66-4926-a4bb-35446e79b93a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80592024-12-21T06:23:28.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = e9e885c0-4894-4626-9811-ace15c49acc0 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
80602024-12-21T06:23:28.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = e9e885c0-4894-4626-9811-ace15c49acc0 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
80612024-12-21T06:23:28.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = e9e885c0-4894-4626-9811-ace15c49acc0 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
80622024-12-21T06:23:28.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 1da024d3-118b-447e-b86e-9c8a7283049b roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
80632024-12-21T06:23:28.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 1da024d3-118b-447e-b86e-9c8a7283049b resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
80642024-12-21T06:23:28.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 1da024d3-118b-447e-b86e-9c8a7283049b response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
80652024-12-21T06:23:29.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 76601911-2bef-4653-9d66-2b15ccb17224 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80662024-12-21T06:23:29.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 76601911-2bef-4653-9d66-2b15ccb17224 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80672024-12-21T06:23:29.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 76601911-2bef-4653-9d66-2b15ccb17224 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
80682024-12-21T06:23:30.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
80692024-12-21T06:23:30.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80702024-12-21T06:23:30.349ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
80712024-12-21T06:23:30.349ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80722024-12-21T06:23:30.349ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
80732024-12-21T06:23:30.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
80742024-12-21T06:23:30.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80752024-12-21T06:23:30.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80762024-12-21T06:23:30.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80772024-12-21T06:23:30.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80782024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
80792024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
80802024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80812024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80822024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
80832024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80842024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
80852024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
80862024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80872024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80882024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
80892024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80902024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
80912024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80922024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80932024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
80942024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80952024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80962024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80972024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80982024-12-21T06:23:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80992024-12-21T06:23:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81002024-12-21T06:23:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81012024-12-21T06:23:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81022024-12-21T06:23:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81032024-12-21T06:23:30.352ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1541, tv_nsec: 437396868 } })
81042024-12-21T06:23:30.352ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1541, tv_nsec: 437536552 } })
81052024-12-21T06:23:30.352ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
81062024-12-21T06:23:30.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81072024-12-21T06:23:30.352ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
81082024-12-21T06:23:30.352ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.964092ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
81092024-12-21T06:23:30.352ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81102024-12-21T06:23:30.353ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81112024-12-21T06:23:30.353ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81122024-12-21T06:23:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81132024-12-21T06:23:30.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81142024-12-21T06:23:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
81152024-12-21T06:23:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81162024-12-21T06:23:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
81172024-12-21T06:23:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81182024-12-21T06:23:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
81192024-12-21T06:23:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
81202024-12-21T06:23:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
81212024-12-21T06:23:30.355ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
81222024-12-21T06:23:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
81232024-12-21T06:23:30.355ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
81242024-12-21T06:23:30.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81252024-12-21T06:23:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81262024-12-21T06:23:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81272024-12-21T06:23:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81282024-12-21T06:23:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81292024-12-21T06:23:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
81302024-12-21T06:23:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
81312024-12-21T06:23:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
81322024-12-21T06:23:30.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81332024-12-21T06:23:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81342024-12-21T06:23:30.356ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81352024-12-21T06:23:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81362024-12-21T06:23:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
81372024-12-21T06:23:30.356ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81382024-12-21T06:23:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81392024-12-21T06:23:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81402024-12-21T06:23:30.357ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81412024-12-21T06:23:30.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81422024-12-21T06:23:30.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81432024-12-21T06:23:30.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81442024-12-21T06:23:30.359ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81452024-12-21T06:23:30.359ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81462024-12-21T06:23:30.359ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
81472024-12-21T06:23:30.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81482024-12-21T06:23:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81492024-12-21T06:23:30.360ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.716511ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
81502024-12-21T06:23:30.361ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81512024-12-21T06:23:30.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81522024-12-21T06:23:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81532024-12-21T06:23:30.362ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81542024-12-21T06:23:30.362ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1541, tv_nsec: 448039823 } })
81552024-12-21T06:23:30.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81562024-12-21T06:23:30.363ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
81572024-12-21T06:23:30.363ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81582024-12-21T06:23:30.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81592024-12-21T06:23:30.363ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81602024-12-21T06:23:30.364ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.497094ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81612024-12-21T06:23:30.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81622024-12-21T06:23:30.364ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81632024-12-21T06:23:30.367ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81642024-12-21T06:23:30.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81652024-12-21T06:23:30.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81662024-12-21T06:23:30.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81672024-12-21T06:23:30.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81682024-12-21T06:23:30.394ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81692024-12-21T06:23:30.394ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81702024-12-21T06:23:30.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81712024-12-21T06:23:30.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81722024-12-21T06:23:30.396ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81732024-12-21T06:23:30.397ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81742024-12-21T06:23:30.398ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81752024-12-21T06:23:30.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81762024-12-21T06:23:30.399ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81772024-12-21T06:23:30.399ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
81782024-12-21T06:23:30.399ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81792024-12-21T06:23:30.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81802024-12-21T06:23:30.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
81812024-12-21T06:23:30.399ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81822024-12-21T06:23:30.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81832024-12-21T06:23:30.400ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
81842024-12-21T06:23:30.400ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81852024-12-21T06:23:30.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81862024-12-21T06:23:30.401ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81872024-12-21T06:23:30.401ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.21738ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
81882024-12-21T06:23:30.402ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81892024-12-21T06:23:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81902024-12-21T06:23:30.403ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 52.429114ms iteration = 20 status = 0
81912024-12-21T06:23:30.403ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.787075ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
81922024-12-21T06:23:30.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
81932024-12-21T06:23:30.403ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81942024-12-21T06:23:30.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81952024-12-21T06:23:30.404ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81962024-12-21T06:23:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81972024-12-21T06:23:30.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81982024-12-21T06:23:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81992024-12-21T06:23:30.416ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
82002024-12-21T06:23:30.416ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.444691ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
82012024-12-21T06:23:30.427ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
82022024-12-21T06:23:30.427ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82032024-12-21T06:23:30.427ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fc64780-8a0e-4815-878e-eea3600b5f2e", "content-length": "26", "date": "Sat, 21 Dec 2024 06:23:30 GMT"} })
82042024-12-21T06:23:30.427ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82052024-12-21T06:23:30.430ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82062024-12-21T06:23:30.431ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
82072024-12-21T06:23:30.431ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82082024-12-21T06:23:30.431ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6b25c0f-9180-4bc5-a3e8-1f75d5ff951c", "content-length": "26", "date": "Sat, 21 Dec 2024 06:23:30 GMT"} })
82092024-12-21T06:23:30.431ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82102024-12-21T06:23:30.433ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82112024-12-21T06:23:30.436ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82122024-12-21T06:23:30.436ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
82132024-12-21T06:23:30.436ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 85.846291ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
82142024-12-21T06:23:30.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82152024-12-21T06:23:30.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82162024-12-21T06:23:30.439ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 84.00879ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82172024-12-21T06:23:30.441ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
82182024-12-21T06:23:30.441ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.899412ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
82192024-12-21T06:23:30.462ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
82202024-12-21T06:23:30.462ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82212024-12-21T06:23:30.463ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4dd65e0-1eee-492d-a921-86ad9682af35", "content-length": "26", "date": "Sat, 21 Dec 2024 06:23:30 GMT"} })
82222024-12-21T06:23:30.463ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82232024-12-21T06:23:30.464ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
82242024-12-21T06:23:30.475ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.100071ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
82252024-12-21T06:23:30.477ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82262024-12-21T06:23:30.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82272024-12-21T06:23:30.480ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82282024-12-21T06:23:30.481ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82292024-12-21T06:23:30.481ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82302024-12-21T06:23:30.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82312024-12-21T06:23:30.483ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82322024-12-21T06:23:30.485ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82332024-12-21T06:23:30.485ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82342024-12-21T06:23:30.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82352024-12-21T06:23:30.510ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.37614ms iteration = 23 status = {"physical_disks_added":0}
82362024-12-21T06:23:30.558ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 208.991996ms iteration = 20 status = {}
82372024-12-21T06:23:30.653ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
82382024-12-21T06:23:30.653ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1844358f-2679-46d9-99d8-1119d5614e3b", "content-length": "1", "date": "Sat, 21 Dec 2024 06:23:30 GMT"} })
82392024-12-21T06:23:30.655ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82402024-12-21T06:23:30.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82412024-12-21T06:23:30.660ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
82422024-12-21T06:23:30.660ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82432024-12-21T06:23:30.660ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e97a8302-1f1a-45c7-b31d-9f58362d0415", "content-length": "372", "date": "Sat, 21 Dec 2024 06:23:30 GMT"} })
82442024-12-21T06:23:30.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82452024-12-21T06:23:30.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82462024-12-21T06:23:30.663ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 313.776973ms iteration = 20 status = null
82472024-12-21T06:23:30.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 45420ee3-3105-4c91-a59e-ece4bb648a58 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
82482024-12-21T06:23:30.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 45420ee3-3105-4c91-a59e-ece4bb648a58 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
82492024-12-21T06:23:30.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 45420ee3-3105-4c91-a59e-ece4bb648a58 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
82502024-12-21T06:23:30.708ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
82512024-12-21T06:23:30.708ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
82522024-12-21T06:23:30.708ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "21c0b4c7-e5bb-491f-b0bc-fe3724c2fcfd", "date": "Sat, 21 Dec 2024 06:23:30 GMT"} })
82532024-12-21T06:23:30.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82542024-12-21T06:23:30.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82552024-12-21T06:23:30.709ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82562024-12-21T06:23:30.709ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3bd167a-3605-4b50-a640-4ea71d82bd3c", "content-length": "691", "date": "Sat, 21 Dec 2024 06:23:30 GMT"} })
82572024-12-21T06:23:30.709ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
82582024-12-21T06:23:30.709ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
82592024-12-21T06:23:30.709ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
82602024-12-21T06:23:30.710ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 359.976034ms iteration = 20 status = {}
82612024-12-21T06:23:30.711ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82622024-12-21T06:23:30.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82632024-12-21T06:23:30.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82642024-12-21T06:23:30.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82652024-12-21T06:23:30.714ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82662024-12-21T06:23:30.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82672024-12-21T06:23:30.715ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
82682024-12-21T06:23:30.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82692024-12-21T06:23:30.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82702024-12-21T06:23:30.718ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
82712024-12-21T06:23:30.718ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82722024-12-21T06:23:30.718ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f07e5d58-418c-4ef2-8178-b5df024f2111", "date": "Sat, 21 Dec 2024 06:23:30 GMT"} })
82732024-12-21T06:23:30.720ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 364.400717ms iteration = 21 status = {}
82742024-12-21T06:23:30.725ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
82752024-12-21T06:23:30.726ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b9667b4-3a33-40e8-bace-4f836f110033", "content-length": "134", "date": "Sat, 21 Dec 2024 06:23:30 GMT"} })
82762024-12-21T06:23:30.726ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
82772024-12-21T06:23:30.726ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
82782024-12-21T06:23:30.726ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
82792024-12-21T06:23:30.726ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
82802024-12-21T06:23:30.726ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82812024-12-21T06:23:30.726ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82822024-12-21T06:23:30.726ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82832024-12-21T06:23:30.726ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82842024-12-21T06:23:30.726ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
82852024-12-21T06:23:30.726ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
82862024-12-21T06:23:30.726ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
82872024-12-21T06:23:30.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82882024-12-21T06:23:30.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82892024-12-21T06:23:30.728ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
82902024-12-21T06:23:30.728ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0daa1a12-72c2-4ce1-b4d1-bcc5d841078a", "content-length": "2", "date": "Sat, 21 Dec 2024 06:23:30 GMT"} })
82912024-12-21T06:23:30.728ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
82922024-12-21T06:23:30.728ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "592d95f9-1210-4ec0-8d68-17d8495134d4", "content-length": "52", "date": "Sat, 21 Dec 2024 06:23:30 GMT"} })
82932024-12-21T06:23:30.728ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
82942024-12-21T06:23:30.728ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
82952024-12-21T06:23:30.823ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ea879317-655d-450e-bbb7-b381b85857f7", "date": "Sat, 21 Dec 2024 06:23:30 GMT"} })
82962024-12-21T06:23:30.823ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
82972024-12-21T06:23:30.823ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
82982024-12-21T06:23:30.823ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a79f9cb-b371-4bd7-9e54-9d15f5b080e5", "content-length": "682", "date": "Sat, 21 Dec 2024 06:23:30 GMT"} })
82992024-12-21T06:23:30.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83002024-12-21T06:23:30.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83012024-12-21T06:23:30.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83022024-12-21T06:23:30.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83032024-12-21T06:23:30.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83042024-12-21T06:23:30.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83052024-12-21T06:23:30.831ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83062024-12-21T06:23:30.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83072024-12-21T06:23:30.838ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 488.312764ms iteration = 20 status = {}
83082024-12-21T06:23:31.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 7d9844a0-e023-4a39-af12-ba3b3358d9f0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
83092024-12-21T06:23:31.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 7d9844a0-e023-4a39-af12-ba3b3358d9f0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
83102024-12-21T06:23:31.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 7d9844a0-e023-4a39-af12-ba3b3358d9f0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
83112024-12-21T06:23:31.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ed4ab05a-2c72-4490-93fb-73e1a5bee0e8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83122024-12-21T06:23:31.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ed4ab05a-2c72-4490-93fb-73e1a5bee0e8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83132024-12-21T06:23:31.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ed4ab05a-2c72-4490-93fb-73e1a5bee0e8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83142024-12-21T06:23:32.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a5cf7d30-9d23-4a88-86c1-df87530a5e77 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83152024-12-21T06:23:32.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a5cf7d30-9d23-4a88-86c1-df87530a5e77 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83162024-12-21T06:23:32.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a5cf7d30-9d23-4a88-86c1-df87530a5e77 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83172024-12-21T06:23:33.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c9d51f33-7e6d-4e0f-825b-c35fbc5083de roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83182024-12-21T06:23:33.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c9d51f33-7e6d-4e0f-825b-c35fbc5083de resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83192024-12-21T06:23:33.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c9d51f33-7e6d-4e0f-825b-c35fbc5083de response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83202024-12-21T06:23:33.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1211 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 87e4eeec-0028-4d65-8bca-62ba7704a774 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
83212024-12-21T06:23:34.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8a6f72bb-5569-460e-9e2d-26143e232522 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83222024-12-21T06:23:34.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8a6f72bb-5569-460e-9e2d-26143e232522 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83232024-12-21T06:23:34.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8a6f72bb-5569-460e-9e2d-26143e232522 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83242024-12-21T06:23:35.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e82bd418-e98b-471f-9012-a8f07aad3854 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83252024-12-21T06:23:35.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e82bd418-e98b-471f-9012-a8f07aad3854 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83262024-12-21T06:23:35.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e82bd418-e98b-471f-9012-a8f07aad3854 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83272024-12-21T06:23:36.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bffe4d14-3069-4436-bd4e-2a76a873e33c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83282024-12-21T06:23:36.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bffe4d14-3069-4436-bd4e-2a76a873e33c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83292024-12-21T06:23:36.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2300 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bffe4d14-3069-4436-bd4e-2a76a873e33c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83302024-12-21T06:23:37.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6b9e14b1-8645-482f-aaf8-da38fe007ef5 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83312024-12-21T06:23:37.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6b9e14b1-8645-482f-aaf8-da38fe007ef5 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83322024-12-21T06:23:37.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1989 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6b9e14b1-8645-482f-aaf8-da38fe007ef5 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83332024-12-21T06:23:38.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d00baf87-d7c0-42a8-9170-aed2e7249080 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83342024-12-21T06:23:38.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d00baf87-d7c0-42a8-9170-aed2e7249080 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83352024-12-21T06:23:38.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2722 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d00baf87-d7c0-42a8-9170-aed2e7249080 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83362024-12-21T06:23:39.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ac93725a-fd42-457c-b7d7-e7b8fda25fab roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83372024-12-21T06:23:39.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ac93725a-fd42-457c-b7d7-e7b8fda25fab resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83382024-12-21T06:23:39.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2043 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ac93725a-fd42-457c-b7d7-e7b8fda25fab response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83392024-12-21T06:23:40.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
83402024-12-21T06:23:40.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83412024-12-21T06:23:40.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83422024-12-21T06:23:40.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
83432024-12-21T06:23:40.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83442024-12-21T06:23:40.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83452024-12-21T06:23:40.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83462024-12-21T06:23:40.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83472024-12-21T06:23:40.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83482024-12-21T06:23:40.354ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.810885ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83492024-12-21T06:23:40.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83502024-12-21T06:23:40.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83512024-12-21T06:23:40.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83522024-12-21T06:23:40.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83532024-12-21T06:23:40.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83542024-12-21T06:23:40.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83552024-12-21T06:23:40.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
83562024-12-21T06:23:40.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83572024-12-21T06:23:40.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83582024-12-21T06:23:40.368ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
83592024-12-21T06:23:40.368ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.212693ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
83602024-12-21T06:23:40.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f677a28f-888c-43b1-8afb-31bc0d6ab705 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83612024-12-21T06:23:40.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f677a28f-888c-43b1-8afb-31bc0d6ab705 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83622024-12-21T06:23:40.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f677a28f-888c-43b1-8afb-31bc0d6ab705 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83632024-12-21T06:23:41.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5ff84133-c8cb-4aa3-b0ee-26c52320c502 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83642024-12-21T06:23:41.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5ff84133-c8cb-4aa3-b0ee-26c52320c502 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83652024-12-21T06:23:41.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5ff84133-c8cb-4aa3-b0ee-26c52320c502 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83662024-12-21T06:23:42.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fa82d778-a4e1-43c0-9328-dcb39bb42d2c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83672024-12-21T06:23:42.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fa82d778-a4e1-43c0-9328-dcb39bb42d2c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83682024-12-21T06:23:42.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fa82d778-a4e1-43c0-9328-dcb39bb42d2c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83692024-12-21T06:23:43.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1268 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 4c757efc-65de-4e92-bf7d-27a698f56e41 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
83702024-12-21T06:23:43.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13c906e1-47bb-4da2-bca3-95dbde455e88 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83712024-12-21T06:23:43.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13c906e1-47bb-4da2-bca3-95dbde455e88 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83722024-12-21T06:23:43.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13c906e1-47bb-4da2-bca3-95dbde455e88 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83732024-12-21T06:23:44.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 867efe99-3aee-40ad-9d30-534d0d17aac1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83742024-12-21T06:23:44.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 867efe99-3aee-40ad-9d30-534d0d17aac1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83752024-12-21T06:23:44.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 867efe99-3aee-40ad-9d30-534d0d17aac1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83762024-12-21T06:23:46.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f2925c12-b38a-4fd2-b1f3-b577d970cac6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83772024-12-21T06:23:46.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f2925c12-b38a-4fd2-b1f3-b577d970cac6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83782024-12-21T06:23:46.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f2925c12-b38a-4fd2-b1f3-b577d970cac6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83792024-12-21T06:23:47.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 986c294f-b887-47e0-9ab4-e9fe3fd020bb roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83802024-12-21T06:23:47.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 986c294f-b887-47e0-9ab4-e9fe3fd020bb resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83812024-12-21T06:23:47.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2590 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 986c294f-b887-47e0-9ab4-e9fe3fd020bb response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83822024-12-21T06:23:48.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d5751e79-15fe-4378-82c1-4331855387b0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83832024-12-21T06:23:48.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d5751e79-15fe-4378-82c1-4331855387b0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83842024-12-21T06:23:48.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d5751e79-15fe-4378-82c1-4331855387b0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83852024-12-21T06:23:49.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 37eed9ee-2290-4179-8668-2e64b73523d6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83862024-12-21T06:23:49.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 37eed9ee-2290-4179-8668-2e64b73523d6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83872024-12-21T06:23:49.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 37eed9ee-2290-4179-8668-2e64b73523d6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83882024-12-21T06:23:50.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3896a5bd-bfec-4011-80b7-58827a95133d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83892024-12-21T06:23:50.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3896a5bd-bfec-4011-80b7-58827a95133d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83902024-12-21T06:23:50.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3896a5bd-bfec-4011-80b7-58827a95133d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
83912024-12-21T06:23:50.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
83922024-12-21T06:23:50.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83932024-12-21T06:23:50.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83942024-12-21T06:23:50.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
83952024-12-21T06:23:50.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83962024-12-21T06:23:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83972024-12-21T06:23:50.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83982024-12-21T06:23:50.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83992024-12-21T06:23:50.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84002024-12-21T06:23:50.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84012024-12-21T06:23:50.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84022024-12-21T06:23:50.353ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.554009ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84032024-12-21T06:23:50.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84042024-12-21T06:23:50.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84052024-12-21T06:23:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84062024-12-21T06:23:50.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84072024-12-21T06:23:50.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
84082024-12-21T06:23:50.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84092024-12-21T06:23:50.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84102024-12-21T06:23:50.369ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
84112024-12-21T06:23:50.369ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.82563ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
84122024-12-21T06:23:51.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ae33c0a8-08da-4cc5-8024-b6086cfc2da1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84132024-12-21T06:23:51.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ae33c0a8-08da-4cc5-8024-b6086cfc2da1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84142024-12-21T06:23:51.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ae33c0a8-08da-4cc5-8024-b6086cfc2da1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84152024-12-21T06:23:52.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = db4379c1-42c6-46cf-9fc2-d745c70a90f0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84162024-12-21T06:23:52.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = db4379c1-42c6-46cf-9fc2-d745c70a90f0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84172024-12-21T06:23:52.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = db4379c1-42c6-46cf-9fc2-d745c70a90f0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84182024-12-21T06:23:53.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 77057677-efff-46b3-b477-c2304203982e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84192024-12-21T06:23:53.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 77057677-efff-46b3-b477-c2304203982e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84202024-12-21T06:23:53.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 77057677-efff-46b3-b477-c2304203982e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84212024-12-21T06:23:53.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1232 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 61bd6e23-5ac8-43d0-983d-e3d4bced3aef response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
84222024-12-21T06:23:54.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 92eb019e-bff6-4351-a438-57998c262ecd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84232024-12-21T06:23:54.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 92eb019e-bff6-4351-a438-57998c262ecd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84242024-12-21T06:23:54.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 92eb019e-bff6-4351-a438-57998c262ecd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84252024-12-21T06:23:55.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9ec0c8c7-afe9-4743-a1cd-e7b409bcf8cd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84262024-12-21T06:23:55.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9ec0c8c7-afe9-4743-a1cd-e7b409bcf8cd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84272024-12-21T06:23:55.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9ec0c8c7-afe9-4743-a1cd-e7b409bcf8cd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84282024-12-21T06:23:56.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 744f6231-18de-4e70-8a51-80b2b31bc786 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84292024-12-21T06:23:56.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 744f6231-18de-4e70-8a51-80b2b31bc786 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84302024-12-21T06:23:56.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 744f6231-18de-4e70-8a51-80b2b31bc786 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84312024-12-21T06:23:57.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c75dc240-096d-4cb8-8ff8-f627275aeaad roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84322024-12-21T06:23:57.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c75dc240-096d-4cb8-8ff8-f627275aeaad resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84332024-12-21T06:23:57.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c75dc240-096d-4cb8-8ff8-f627275aeaad response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84342024-12-21T06:23:58.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a1e7fb95-e137-4d4e-9617-b8255c54757e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84352024-12-21T06:23:58.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a1e7fb95-e137-4d4e-9617-b8255c54757e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84362024-12-21T06:23:58.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a1e7fb95-e137-4d4e-9617-b8255c54757e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84372024-12-21T06:23:58.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 56d831df-959b-4504-8a2a-e9196668779e roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
84382024-12-21T06:23:58.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 56d831df-959b-4504-8a2a-e9196668779e resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
84392024-12-21T06:23:58.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 56d831df-959b-4504-8a2a-e9196668779e response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
84402024-12-21T06:23:58.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 51c2d386-1ff3-42cc-b671-ee6bfcc11b6e roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
84412024-12-21T06:23:58.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 51c2d386-1ff3-42cc-b671-ee6bfcc11b6e resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
84422024-12-21T06:23:58.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 51c2d386-1ff3-42cc-b671-ee6bfcc11b6e response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
84432024-12-21T06:23:59.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e4b68c40-ebb4-4471-a329-253c511ca744 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84442024-12-21T06:23:59.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e4b68c40-ebb4-4471-a329-253c511ca744 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84452024-12-21T06:23:59.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e4b68c40-ebb4-4471-a329-253c511ca744 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84462024-12-21T06:24:00.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 80eeeaf3-d1ad-4d66-a81c-2c87e87d0edc roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84472024-12-21T06:24:00.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 80eeeaf3-d1ad-4d66-a81c-2c87e87d0edc resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84482024-12-21T06:24:00.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2071 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 80eeeaf3-d1ad-4d66-a81c-2c87e87d0edc response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
84492024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
84502024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
84512024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
84522024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84532024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84542024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
84552024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
84562024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
84572024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
84582024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84592024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
84602024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
84612024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
84622024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
84632024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
84642024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
84652024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84662024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84672024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
84682024-12-21T06:24:00.349ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 7c419228-2431-4394-af83-ea0457364b70
84692024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.241\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"7c419228-2431-4394-af83-ea0457364b70"}
84702024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
84712024-12-21T06:24:00.349ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 06:14:00.349740969 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
84722024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
84732024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
84742024-12-21T06:24:00.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84752024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84762024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84772024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84782024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84792024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84802024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
84812024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
84822024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
84832024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84842024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84852024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
84862024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84872024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
84882024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84892024-12-21T06:24:00.350ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
84902024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
84912024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84922024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84932024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
84942024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
84952024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
84962024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
84972024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84982024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84992024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
85002024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85012024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
85022024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
85032024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85042024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85052024-12-21T06:24:00.350ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("068965c6-3480-4953-b57e-dd969abb2a21.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("45c0a855-5592-491c-b7b3-470902319db2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1571, tv_nsec: 435764752 } })
85062024-12-21T06:24:00.350ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1571, tv_nsec: 435774823 } })
85072024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
85082024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85092024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
85102024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85112024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85122024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85132024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85142024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85152024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85162024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
85172024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85182024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85192024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85202024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
85212024-12-21T06:24:00.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.328727ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
85222024-12-21T06:24:00.351ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
85232024-12-21T06:24:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.303706ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
85242024-12-21T06:24:00.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85252024-12-21T06:24:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85262024-12-21T06:24:00.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85272024-12-21T06:24:00.352ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1571, tv_nsec: 437987884 } })
85282024-12-21T06:24:00.352ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
85292024-12-21T06:24:00.353ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85302024-12-21T06:24:00.353ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.272719ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85312024-12-21T06:24:00.354ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
85322024-12-21T06:24:00.354ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
85332024-12-21T06:24:00.354ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85342024-12-21T06:24:00.354ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 06:14:00.349740969 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
85352024-12-21T06:24:00.354ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.652979ms iteration = 11 status = {"expiration":"2024-12-21T06:14:00.349740969Z","pruned":[]}
85362024-12-21T06:24:00.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85372024-12-21T06:24:00.354ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1571, tv_nsec: 439843765 } })
85382024-12-21T06:24:00.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
85392024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85402024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85412024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85422024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
85432024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
85442024-12-21T06:24:00.355ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
85452024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
85462024-12-21T06:24:00.355ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
85472024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
85482024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
85492024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
85502024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85512024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
85522024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
85532024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
85542024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
85552024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
85562024-12-21T06:24:00.355ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
85572024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85582024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
85592024-12-21T06:24:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85602024-12-21T06:24:00.356ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
85612024-12-21T06:24:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85622024-12-21T06:24:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
85632024-12-21T06:24:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
85642024-12-21T06:24:00.356ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
85652024-12-21T06:24:00.356ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85662024-12-21T06:24:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85672024-12-21T06:24:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
85682024-12-21T06:24:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85692024-12-21T06:24:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
85702024-12-21T06:24:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85712024-12-21T06:24:00.357ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85722024-12-21T06:24:00.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85732024-12-21T06:24:00.359ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85742024-12-21T06:24:00.359ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
85752024-12-21T06:24:00.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85762024-12-21T06:24:00.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85772024-12-21T06:24:00.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85782024-12-21T06:24:00.360ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85792024-12-21T06:24:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85802024-12-21T06:24:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85812024-12-21T06:24:00.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85822024-12-21T06:24:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85832024-12-21T06:24:00.362ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85842024-12-21T06:24:00.362ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85852024-12-21T06:24:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85862024-12-21T06:24:00.363ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85872024-12-21T06:24:00.363ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85882024-12-21T06:24:00.364ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
85892024-12-21T06:24:00.364ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
85902024-12-21T06:24:00.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
85912024-12-21T06:24:00.366ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85922024-12-21T06:24:00.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85932024-12-21T06:24:00.366ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
85942024-12-21T06:24:00.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
85952024-12-21T06:24:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85962024-12-21T06:24:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85972024-12-21T06:24:00.368ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
85982024-12-21T06:24:00.368ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
85992024-12-21T06:24:00.368ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
86002024-12-21T06:24:00.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86012024-12-21T06:24:00.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86022024-12-21T06:24:00.368ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86032024-12-21T06:24:00.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86042024-12-21T06:24:00.370ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.39309ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
86052024-12-21T06:24:00.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86062024-12-21T06:24:00.371ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.825128ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
86072024-12-21T06:24:00.372ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86082024-12-21T06:24:00.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86092024-12-21T06:24:00.373ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86102024-12-21T06:24:00.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86112024-12-21T06:24:00.373ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86122024-12-21T06:24:00.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86132024-12-21T06:24:00.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86142024-12-21T06:24:00.377ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1571, tv_nsec: 462872204 } })
86152024-12-21T06:24:00.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86162024-12-21T06:24:00.377ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
86172024-12-21T06:24:00.378ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86182024-12-21T06:24:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86192024-12-21T06:24:00.378ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 23.004668ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86202024-12-21T06:24:00.379ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86212024-12-21T06:24:00.379ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.886821ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86222024-12-21T06:24:00.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86232024-12-21T06:24:00.382ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86242024-12-21T06:24:00.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86252024-12-21T06:24:00.383ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86262024-12-21T06:24:00.384ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86272024-12-21T06:24:00.387ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86282024-12-21T06:24:00.387ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86292024-12-21T06:24:00.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86302024-12-21T06:24:00.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
86312024-12-21T06:24:00.388ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86322024-12-21T06:24:00.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86332024-12-21T06:24:00.390ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86342024-12-21T06:24:00.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86352024-12-21T06:24:00.393ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86362024-12-21T06:24:00.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86372024-12-21T06:24:00.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
86382024-12-21T06:24:00.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
86392024-12-21T06:24:00.397ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(8a026da6-2edf-49c9-8fec-3f9e62db6705, 0), (acf316af-ed65-461f-8ba5-8c61cf11fcdd, 0), (102fa988-1550-4d79-a146-432e1c082c52, 0), (54ddba23-15ed-493e-80c2-a6039a97c451, 0)] collection_id = 8a026da6-2edf-49c9-8fec-3f9e62db6705
86402024-12-21T06:24:00.397ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
86412024-12-21T06:24:00.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
86422024-12-21T06:24:00.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86432024-12-21T06:24:00.401ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86442024-12-21T06:24:00.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86452024-12-21T06:24:00.403ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86462024-12-21T06:24:00.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86472024-12-21T06:24:00.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
86482024-12-21T06:24:00.404ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
86492024-12-21T06:24:00.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
86502024-12-21T06:24:00.406ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.639764ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
86512024-12-21T06:24:00.406ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86522024-12-21T06:24:00.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86532024-12-21T06:24:00.409ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
86542024-12-21T06:24:00.409ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
86552024-12-21T06:24:00.409ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
86562024-12-21T06:24:00.409ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86572024-12-21T06:24:00.409ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
86582024-12-21T06:24:00.409ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
86592024-12-21T06:24:00.409ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 53.901895ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
86602024-12-21T06:24:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86612024-12-21T06:24:00.410ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86622024-12-21T06:24:00.410ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
86632024-12-21T06:24:00.410ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86642024-12-21T06:24:00.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86652024-12-21T06:24:00.411ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86662024-12-21T06:24:00.411ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86672024-12-21T06:24:00.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
86682024-12-21T06:24:00.413ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86692024-12-21T06:24:00.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86702024-12-21T06:24:00.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
86712024-12-21T06:24:00.414ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86722024-12-21T06:24:00.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86732024-12-21T06:24:00.414ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
86742024-12-21T06:24:00.414ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 73ea2545-5d76-4a86-9d95-ff3853ca0186
86752024-12-21T06:24:00.414ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 07b76566-2cdb-4482-baf3-f8ebb775b54e
86762024-12-21T06:24:00.414ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 255935bc-90dc-4194-8435-cb16a5c4de26
86772024-12-21T06:24:00.414ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 07b76566-2cdb-4482-baf3-f8ebb775b54e
86782024-12-21T06:24:00.414ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 255935bc-90dc-4194-8435-cb16a5c4de26
86792024-12-21T06:24:00.417ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 73ea2545-5d76-4a86-9d95-ff3853ca0186
86802024-12-21T06:24:00.417ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 61.588728ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
86812024-12-21T06:24:00.419ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.327303ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86822024-12-21T06:24:00.419ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.697083ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86832024-12-21T06:24:00.423ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
86842024-12-21T06:24:00.423ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
86852024-12-21T06:24:00.423ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86862024-12-21T06:24:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86872024-12-21T06:24:00.425ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
86882024-12-21T06:24:00.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
86892024-12-21T06:24:00.429ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86902024-12-21T06:24:00.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86912024-12-21T06:24:00.445ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86922024-12-21T06:24:00.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86932024-12-21T06:24:00.505ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
86942024-12-21T06:24:00.509ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
86952024-12-21T06:24:00.522ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86962024-12-21T06:24:00.522ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86972024-12-21T06:24:00.523ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d66415ae-e4b7-4a81-a4ba-7523d5749a8b", "content-length": "26", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
86982024-12-21T06:24:00.523ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86992024-12-21T06:24:00.525ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87002024-12-21T06:24:00.581ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
87012024-12-21T06:24:00.581ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87022024-12-21T06:24:00.581ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "197f0968-23e7-41eb-b7ba-6bc224e3da6d", "content-length": "26", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
87032024-12-21T06:24:00.581ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87042024-12-21T06:24:00.583ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
87052024-12-21T06:24:00.614ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
87062024-12-21T06:24:00.614ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87072024-12-21T06:24:00.615ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee260960-6b12-4b46-aacd-d669fb3630e2", "content-length": "26", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
87082024-12-21T06:24:00.615ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87092024-12-21T06:24:00.616ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87102024-12-21T06:24:00.660ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
87112024-12-21T06:24:00.660ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87122024-12-21T06:24:00.660ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "526d4e8c-4d83-46b3-9e6d-8eb3ae92228b", "content-length": "372", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
87132024-12-21T06:24:00.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87142024-12-21T06:24:00.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87152024-12-21T06:24:00.662ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87162024-12-21T06:24:00.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87172024-12-21T06:24:00.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87182024-12-21T06:24:00.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
87192024-12-21T06:24:00.666ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87202024-12-21T06:24:00.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87212024-12-21T06:24:00.669ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87222024-12-21T06:24:00.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87232024-12-21T06:24:00.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87242024-12-21T06:24:00.672ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87252024-12-21T06:24:00.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87262024-12-21T06:24:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
87272024-12-21T06:24:00.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
87282024-12-21T06:24:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
87292024-12-21T06:24:00.682ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
87302024-12-21T06:24:00.682ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
87312024-12-21T06:24:00.682ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 06:14:07.931887 UTC dns_group = internal generation = 1
87322024-12-21T06:24:00.682ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 332.712877ms iteration = 12 status = {"generation":1}
87332024-12-21T06:24:00.692ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
87342024-12-21T06:24:00.692ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 343.078745ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
87352024-12-21T06:24:00.694ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
87362024-12-21T06:24:00.698ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87372024-12-21T06:24:00.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87382024-12-21T06:24:00.700ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
87392024-12-21T06:24:00.700ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
87402024-12-21T06:24:00.700ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 350.727137ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
87412024-12-21T06:24:00.701ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
87422024-12-21T06:24:00.701ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "934a9b91-59ed-4bb8-a25f-528723b13855", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87432024-12-21T06:24:00.701ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87442024-12-21T06:24:00.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87452024-12-21T06:24:00.703ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4cdc3d81-3cf6-4f33-a9a4-9da3735523a3", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87462024-12-21T06:24:00.703ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87472024-12-21T06:24:00.704ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87482024-12-21T06:24:00.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87492024-12-21T06:24:00.705ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
87502024-12-21T06:24:00.705ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 355.697745ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
87512024-12-21T06:24:00.705ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
87522024-12-21T06:24:00.705ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
87532024-12-21T06:24:00.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
87542024-12-21T06:24:00.706ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87552024-12-21T06:24:00.707ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87562024-12-21T06:24:00.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87572024-12-21T06:24:00.707ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87582024-12-21T06:24:00.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87592024-12-21T06:24:00.708ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
87602024-12-21T06:24:00.708ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
87612024-12-21T06:24:00.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
87622024-12-21T06:24:00.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87632024-12-21T06:24:00.714ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87642024-12-21T06:24:00.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87652024-12-21T06:24:00.715ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
87662024-12-21T06:24:00.715ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87672024-12-21T06:24:00.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87682024-12-21T06:24:00.717ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87692024-12-21T06:24:00.717ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
87702024-12-21T06:24:00.717ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 367.051081ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
87712024-12-21T06:24:00.717ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 367.238235ms iteration = 21 status = 0
87722024-12-21T06:24:00.722ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87732024-12-21T06:24:00.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87742024-12-21T06:24:00.723ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87752024-12-21T06:24:00.724ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 8a026da6-2edf-49c9-8fec-3f9e62db6705 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
87762024-12-21T06:24:00.724ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
87772024-12-21T06:24:00.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
87782024-12-21T06:24:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
87792024-12-21T06:24:00.728ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87802024-12-21T06:24:00.728ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
87812024-12-21T06:24:00.728ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
87822024-12-21T06:24:00.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87832024-12-21T06:24:00.728ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7cad6ba3-6381-4a77-a63e-c799fec40709", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
87842024-12-21T06:24:00.728ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87852024-12-21T06:24:00.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87862024-12-21T06:24:00.730ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87872024-12-21T06:24:00.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87882024-12-21T06:24:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87892024-12-21T06:24:00.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87902024-12-21T06:24:00.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 377.422228ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
87912024-12-21T06:24:00.733ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87922024-12-21T06:24:00.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87932024-12-21T06:24:00.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87942024-12-21T06:24:00.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87952024-12-21T06:24:00.735ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87962024-12-21T06:24:00.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87972024-12-21T06:24:00.737ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
87982024-12-21T06:24:00.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
87992024-12-21T06:24:00.738ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
88002024-12-21T06:24:00.738ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88012024-12-21T06:24:00.739ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f00db5c3-2117-46e3-b590-4ab330b97c78", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88022024-12-21T06:24:00.740ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
88032024-12-21T06:24:00.740ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 0 version = 2
88042024-12-21T06:24:00.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88052024-12-21T06:24:00.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88062024-12-21T06:24:00.741ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 385.256335ms iteration = 22 status = {}
88072024-12-21T06:24:00.743ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(acf316af-ed65-461f-8ba5-8c61cf11fcdd, 0), (102fa988-1550-4d79-a146-432e1c082c52, 0), (54ddba23-15ed-493e-80c2-a6039a97c451, 0)]
88082024-12-21T06:24:00.744ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1571, tv_nsec: 829500383 } })
88092024-12-21T06:24:00.752ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T06:13:58.796551Z, time_modified: 2024-12-21T06:13:58.796551Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }) }
88102024-12-21T06:24:00.752ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 403.031008ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]}},"default_endpoint":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
88112024-12-21T06:24:00.773ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 423.614388ms iteration = 21 status = {}
88122024-12-21T06:24:00.777ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88132024-12-21T06:24:00.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88142024-12-21T06:24:00.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88152024-12-21T06:24:00.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
88162024-12-21T06:24:00.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88172024-12-21T06:24:00.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88182024-12-21T06:24:00.793ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 1 version = 2
88192024-12-21T06:24:00.793ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
88202024-12-21T06:24:00.793ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 06:14:08.776888 UTC dns_group = external generation = 2
88212024-12-21T06:24:00.793ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 443.48067ms iteration = 12 status = {"generation":2}
88222024-12-21T06:24:00.807ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
88232024-12-21T06:24:00.807ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 456.992464ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
88242024-12-21T06:24:00.807ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88252024-12-21T06:24:00.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88262024-12-21T06:24:00.809ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88272024-12-21T06:24:00.812ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88282024-12-21T06:24:00.812ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88292024-12-21T06:24:00.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88302024-12-21T06:24:00.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88312024-12-21T06:24:00.816ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88322024-12-21T06:24:00.816ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88332024-12-21T06:24:00.816ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
88342024-12-21T06:24:00.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88352024-12-21T06:24:00.816ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9e3fe15-474c-4281-b5fd-858ef6249e4a", "content-length": "1", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88362024-12-21T06:24:00.819ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88372024-12-21T06:24:00.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88382024-12-21T06:24:00.821ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 472.059192ms iteration = 21 status = null
88392024-12-21T06:24:00.824ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88402024-12-21T06:24:00.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88412024-12-21T06:24:00.825ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88422024-12-21T06:24:00.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
88432024-12-21T06:24:00.829ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88442024-12-21T06:24:00.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88452024-12-21T06:24:00.830ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
88462024-12-21T06:24:00.831ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c43e764c-684f-47ce-af50-435ad05d25f6", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
88472024-12-21T06:24:00.831ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
88482024-12-21T06:24:00.831ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
88492024-12-21T06:24:00.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
88502024-12-21T06:24:00.833ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "379766fe-21de-4252-8197-d487b5e3a740", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
88512024-12-21T06:24:00.833ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
88522024-12-21T06:24:00.836ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "99c85384-6b36-4471-a6a1-7ec1ec1a99e6", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
88532024-12-21T06:24:00.836ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
88542024-12-21T06:24:00.838ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
88552024-12-21T06:24:00.838ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 488.846758ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
88562024-12-21T06:24:00.862ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 512.604087ms iteration = 24 status = {"physical_disks_added":0}
88572024-12-21T06:24:00.865ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
88582024-12-21T06:24:00.865ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
88592024-12-21T06:24:00.865ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
88602024-12-21T06:24:00.866ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab71cc9b-8de1-46de-9f90-c2c6930071dd", "content-length": "476", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88612024-12-21T06:24:00.866ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
88622024-12-21T06:24:00.866ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4aaa8c63-3f43-4812-b3fd-7b3f3800a860", "content-length": "734", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88632024-12-21T06:24:00.866ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
88642024-12-21T06:24:00.867ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e0d9532-6c26-4cb1-9280-9889e5838060", "content-length": "111", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88652024-12-21T06:24:00.867ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
88662024-12-21T06:24:00.867ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "22bf983f-c943-49a9-9649-c6ea86d68779", "content-length": "111", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88672024-12-21T06:24:00.867ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
88682024-12-21T06:24:00.867ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "231e87a8-7142-40c2-b73f-dcc90bb8f931", "content-length": "167", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88692024-12-21T06:24:00.867ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
88702024-12-21T06:24:00.868ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e56cd60c-d178-480f-a909-b24ea957cce6", "content-length": "167", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88712024-12-21T06:24:00.868ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
88722024-12-21T06:24:00.868ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e81171cb-04d7-4383-87a0-97ea669831d1", "content-length": "175", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88732024-12-21T06:24:00.868ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
88742024-12-21T06:24:00.868ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c5db634-69e8-4520-a1c5-1e6c0587f351", "content-length": "175", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88752024-12-21T06:24:00.868ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
88762024-12-21T06:24:00.868ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0be04f60-a63f-4d3b-a570-5c769de7300c", "content-length": "702", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88772024-12-21T06:24:00.868ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
88782024-12-21T06:24:00.869ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f16e6ea7-936b-45ae-aa2f-0a1f29820896", "content-length": "727", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88792024-12-21T06:24:00.869ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
88802024-12-21T06:24:00.869ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c7bf00c-c936-439e-90d8-07dd15ce7f62", "content-length": "729", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88812024-12-21T06:24:00.869ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
88822024-12-21T06:24:00.869ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7eb9ef8b-60a8-48ad-b7e1-6778cb389a89", "content-length": "728", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88832024-12-21T06:24:00.869ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
88842024-12-21T06:24:00.869ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5d24b08-7aec-4d5c-af0b-1bf3cd9c4813", "content-length": "722", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88852024-12-21T06:24:00.869ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
88862024-12-21T06:24:00.870ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac8380b1-8bc9-4d4a-a401-4851692bc6fa", "content-length": "109", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88872024-12-21T06:24:00.870ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
88882024-12-21T06:24:00.870ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e8fe9d8-29bc-4e05-8232-ba42a0c5b494", "content-length": "109", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88892024-12-21T06:24:00.870ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
88902024-12-21T06:24:00.870ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "be4300f6-2a97-4166-b44c-0ad80e340c5d", "content-length": "169", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88912024-12-21T06:24:00.871ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
88922024-12-21T06:24:00.871ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "26bdb341-2603-420e-8899-dd54b5888ffd", "content-length": "169", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88932024-12-21T06:24:00.871ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
88942024-12-21T06:24:00.871ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e1a8500-b371-4ea0-a877-b2525c05c2af", "content-length": "178", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88952024-12-21T06:24:00.871ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
88962024-12-21T06:24:00.871ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fa99222-c6eb-45fb-b8a9-292e6328039b", "content-length": "178", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88972024-12-21T06:24:00.871ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
88982024-12-21T06:24:00.872ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d415ccef-8680-4e73-893e-4a50a92967a8", "content-length": "702", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
88992024-12-21T06:24:00.872ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
89002024-12-21T06:24:00.872ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "22751bc6-fbe8-41aa-92ba-5120dbc30f67", "content-length": "727", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
89012024-12-21T06:24:00.872ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
89022024-12-21T06:24:00.872ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c931ac8-22a4-4f84-bfd2-5b9398f63d17", "content-length": "729", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
89032024-12-21T06:24:00.872ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
89042024-12-21T06:24:00.872ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d73d4a0d-9769-41b7-b7eb-7b5a199395ab", "content-length": "728", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
89052024-12-21T06:24:00.872ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
89062024-12-21T06:24:00.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
89072024-12-21T06:24:00.981ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
89082024-12-21T06:24:00.982ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "68817125-5512-4309-ac80-253a75d65a63", "content-length": "691", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
89092024-12-21T06:24:00.982ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
89102024-12-21T06:24:00.982ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
89112024-12-21T06:24:00.982ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
89122024-12-21T06:24:00.984ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 633.797568ms iteration = 21 status = {}
89132024-12-21T06:24:00.985ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89142024-12-21T06:24:00.985ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89152024-12-21T06:24:00.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89162024-12-21T06:24:00.987ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
89172024-12-21T06:24:00.987ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
89182024-12-21T06:24:00.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
89192024-12-21T06:24:00.990ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89202024-12-21T06:24:00.991ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89212024-12-21T06:24:00.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89222024-12-21T06:24:00.993ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
89232024-12-21T06:24:00.993ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
89242024-12-21T06:24:00.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
89252024-12-21T06:24:00.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89262024-12-21T06:24:00.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89272024-12-21T06:24:00.997ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89282024-12-21T06:24:00.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89292024-12-21T06:24:01.000ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
89302024-12-21T06:24:01.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89312024-12-21T06:24:01.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89322024-12-21T06:24:01.013ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
89332024-12-21T06:24:01.013ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "94455af8-7674-45f9-ae16-217343325e6f", "content-length": "134", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
89342024-12-21T06:24:01.014ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
89352024-12-21T06:24:01.014ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
89362024-12-21T06:24:01.014ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
89372024-12-21T06:24:01.014ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89382024-12-21T06:24:01.014ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89392024-12-21T06:24:01.014ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89402024-12-21T06:24:01.014ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89412024-12-21T06:24:01.014ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89422024-12-21T06:24:01.014ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89432024-12-21T06:24:01.014ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89442024-12-21T06:24:01.014ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
89452024-12-21T06:24:01.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89462024-12-21T06:24:01.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89472024-12-21T06:24:01.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89482024-12-21T06:24:01.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89492024-12-21T06:24:01.037ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
89502024-12-21T06:24:01.037ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
89512024-12-21T06:24:01.040ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89522024-12-21T06:24:01.040ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
89532024-12-21T06:24:01.040ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e347c96-2655-4424-8798-2238bf559c51", "content-length": "2", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
89542024-12-21T06:24:01.040ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
89552024-12-21T06:24:01.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89562024-12-21T06:24:01.040ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0218ca8c-d233-4a05-91b6-f5b11bb1787c", "content-length": "52", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
89572024-12-21T06:24:01.040ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
89582024-12-21T06:24:01.040ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
89592024-12-21T06:24:01.069ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89602024-12-21T06:24:01.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
89612024-12-21T06:24:01.073ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89622024-12-21T06:24:01.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89632024-12-21T06:24:01.108ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89642024-12-21T06:24:01.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89652024-12-21T06:24:01.138ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89662024-12-21T06:24:01.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89672024-12-21T06:24:01.152ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9b6501e9-6779-4ea5-b5e9-ef67247fe9da", "date": "Sat, 21 Dec 2024 06:24:01 GMT"} })
89682024-12-21T06:24:01.152ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
89692024-12-21T06:24:01.152ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
89702024-12-21T06:24:01.152ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e14fc4f-da8d-4e8b-8c08-b919e2c9d192", "content-length": "682", "date": "Sat, 21 Dec 2024 06:24:00 GMT"} })
89712024-12-21T06:24:01.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89722024-12-21T06:24:01.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89732024-12-21T06:24:01.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89742024-12-21T06:24:01.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89752024-12-21T06:24:01.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89762024-12-21T06:24:01.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89772024-12-21T06:24:01.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89782024-12-21T06:24:01.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89792024-12-21T06:24:01.164ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89802024-12-21T06:24:01.168ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
89812024-12-21T06:24:01.168ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89822024-12-21T06:24:01.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89832024-12-21T06:24:01.170ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 820.498076ms iteration = 21 status = {}
89842024-12-21T06:24:01.172ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89852024-12-21T06:24:01.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89862024-12-21T06:24:01.173ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89872024-12-21T06:24:01.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89882024-12-21T06:24:01.175ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89892024-12-21T06:24:01.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89902024-12-21T06:24:01.178ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89912024-12-21T06:24:01.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89922024-12-21T06:24:01.180ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89932024-12-21T06:24:01.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89942024-12-21T06:24:01.181ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89952024-12-21T06:24:01.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89962024-12-21T06:24:01.183ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
89972024-12-21T06:24:01.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
89982024-12-21T06:24:01.211ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89992024-12-21T06:24:01.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
90002024-12-21T06:24:01.214ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90012024-12-21T06:24:01.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90022024-12-21T06:24:01.216ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90032024-12-21T06:24:01.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90042024-12-21T06:24:01.217ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90052024-12-21T06:24:01.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90062024-12-21T06:24:01.219ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90072024-12-21T06:24:01.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
90082024-12-21T06:24:01.222ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90092024-12-21T06:24:01.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90102024-12-21T06:24:01.234ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
90112024-12-21T06:24:01.234ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90122024-12-21T06:24:01.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90132024-12-21T06:24:01.235ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90142024-12-21T06:24:01.237ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
90152024-12-21T06:24:01.237ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90162024-12-21T06:24:01.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90172024-12-21T06:24:01.239ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
90182024-12-21T06:24:01.239ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 32139499-be01-46d7-9310-5a302d871eb9, kind: Service { id: 621b6995-ee70-406d-a9fd-e26a95427f65 }, name: Name("external-dns-621b6995-ee70-406d-a9fd-e26a95427f65"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 241, 116])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e731aed4-8af6-4fa4-ae96-cdc6496ad116, kind: Service { id: 48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa }, name: Name("external-dns-48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 216])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 24e2d65c-5929-42f9-bcf3-fb4d82384a15, kind: Service { id: 8507979d-3950-4f99-9dfb-8d7bc8f0ff77 }, name: Name("nexus-8507979d-3950-4f99-9dfb-8d7bc8f0ff77"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69c31d67-07ff-4496-adf7-1dddb818dbf8, kind: Service { id: fdd51b42-d0df-40d7-b6ac-9d3d0296650b }, name: Name("nexus-fdd51b42-d0df-40d7-b6ac-9d3d0296650b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 134, 202])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c3554b25-f5c5-4818-a50a-28d36fa3784d, kind: Service { id: 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb }, name: Name("nexus-0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 177, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
90192024-12-21T06:24:01.239ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
90202024-12-21T06:24:01.253ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "67acc65e-e06f-4d26-9baa-0a25ff5a79b7", "content-length": "30798", "date": "Sat, 21 Dec 2024 06:24:01 GMT"} })
90212024-12-21T06:24:01.255ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
90222024-12-21T06:24:01.255ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
90232024-12-21T06:24:01.255ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
90242024-12-21T06:24:01.257ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
90252024-12-21T06:24:01.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
90262024-12-21T06:24:01.258ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90272024-12-21T06:24:01.260ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
90282024-12-21T06:24:01.260ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
90292024-12-21T06:24:01.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
90302024-12-21T06:24:01.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = b95b255b-3e95-47ce-bd89-7c808f8463a4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
90312024-12-21T06:24:01.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = b95b255b-3e95-47ce-bd89-7c808f8463a4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
90322024-12-21T06:24:01.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = b95b255b-3e95-47ce-bd89-7c808f8463a4 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
90332024-12-21T06:24:01.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0d02d84b-789d-4b6f-baa8-21ccd7e2390b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90342024-12-21T06:24:01.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0d02d84b-789d-4b6f-baa8-21ccd7e2390b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90352024-12-21T06:24:01.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2695 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0d02d84b-789d-4b6f-baa8-21ccd7e2390b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90362024-12-21T06:24:01.360ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: cf7f8320-e45e-46f1-aa3b-b101ce937c63, time_created: 2024-12-21T06:14:06.164830Z, time_modified: 2024-12-21T06:14:06.164830Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
90372024-12-21T06:24:01.360ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
90382024-12-21T06:24:01.360ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90392024-12-21T06:24:01.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90402024-12-21T06:24:01.363ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
90412024-12-21T06:24:01.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
90422024-12-21T06:24:01.365ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90432024-12-21T06:24:01.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
90442024-12-21T06:24:01.423ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
90452024-12-21T06:24:01.424ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "c77e6ae2-a1c6-4d8a-8899-60714974e386", "date": "Sat, 21 Dec 2024 06:24:01 GMT"} })
90462024-12-21T06:24:01.426ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
90472024-12-21T06:24:01.426ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 1.072715001s
90482024-12-21T06:24:01.426ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 1.072727211s iteration = 3 status = {}
90492024-12-21T06:24:01.499ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = c2f2d0e6-3ba6-4174-9c97-deaf3c73ba34 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
90502024-12-21T06:24:01.500ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = c2f2d0e6-3ba6-4174-9c97-deaf3c73ba34 time_started = 2024-12-21 06:24:00.865729 UTC
90512024-12-21T06:24:01.500ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.149890582s iteration = 4 status = {"collection_id":"c2f2d0e6-3ba6-4174-9c97-deaf3c73ba34","time_done":"2024-12-21 06:24:01.255189 UTC","time_started":"2024-12-21 06:24:00.865729 UTC"}
90522024-12-21T06:24:01.500ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
90532024-12-21T06:24:01.500ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90542024-12-21T06:24:01.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90552024-12-21T06:24:01.502ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90562024-12-21T06:24:01.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90572024-12-21T06:24:01.505ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90582024-12-21T06:24:01.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90592024-12-21T06:24:01.521ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90602024-12-21T06:24:01.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90612024-12-21T06:24:01.524ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90622024-12-21T06:24:01.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90632024-12-21T06:24:01.527ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90642024-12-21T06:24:01.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90652024-12-21T06:24:01.682ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 182.576944ms iteration = 25 status = {"physical_disks_added":0}
90662024-12-21T06:24:02.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 03de1e72-e9b8-4680-b3f6-cfbaef35e793 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90672024-12-21T06:24:02.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 03de1e72-e9b8-4680-b3f6-cfbaef35e793 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90682024-12-21T06:24:02.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 03de1e72-e9b8-4680-b3f6-cfbaef35e793 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90692024-12-21T06:24:03.199ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:49418
90702024-12-21T06:24:03.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49418 req_id = 4cfa442f-e849-4c62-8028-db602cd8beb8 roles = RoleSet { roles: {} } uri = /metrics/producers
90712024-12-21T06:24:03.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49418 req_id = 4cfa442f-e849-4c62-8028-db602cd8beb8 resource = Database result = Ok(()) uri = /metrics/producers
90722024-12-21T06:24:03.239ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 98955a77-d432-4135-98da-54d3ff354ace
90732024-12-21T06:24:03.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40662 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49418 req_id = 4cfa442f-e849-4c62-8028-db602cd8beb8 response_code = 201 uri = /metrics/producers
90742024-12-21T06:24:03.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 44fd9c83-1359-4538-9808-9512590a8ee8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90752024-12-21T06:24:03.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 44fd9c83-1359-4538-9808-9512590a8ee8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90762024-12-21T06:24:03.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 44fd9c83-1359-4538-9808-9512590a8ee8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90772024-12-21T06:24:03.838ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:53181
90782024-12-21T06:24:03.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53181 req_id = 8e40defc-2426-4a02-947e-d8611312bb85 roles = RoleSet { roles: {} } uri = /metrics/producers
90792024-12-21T06:24:03.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53181 req_id = 8e40defc-2426-4a02-947e-d8611312bb85 resource = Database result = Ok(()) uri = /metrics/producers
90802024-12-21T06:24:03.879ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = d1b17d65-9e31-4f7b-88f5-d7566540099b
90812024-12-21T06:24:03.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40835 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53181 req_id = 8e40defc-2426-4a02-947e-d8611312bb85 response_code = 201 uri = /metrics/producers
90822024-12-21T06:24:03.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1724 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 93eb8ca5-c447-43d2-b005-b9c2bf0845ad response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
90832024-12-21T06:24:04.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 04a6419f-272f-4e71-980e-0abe98296904 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90842024-12-21T06:24:04.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 04a6419f-272f-4e71-980e-0abe98296904 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90852024-12-21T06:24:04.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 04a6419f-272f-4e71-980e-0abe98296904 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90862024-12-21T06:24:05.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 181e3698-700e-4f35-936f-c72438318223 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90872024-12-21T06:24:05.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 181e3698-700e-4f35-936f-c72438318223 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90882024-12-21T06:24:05.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 181e3698-700e-4f35-936f-c72438318223 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90892024-12-21T06:24:05.549ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33237
90902024-12-21T06:24:05.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33237 req_id = 182a9f58-9e42-47a6-b809-49a3af24c6f0 roles = RoleSet { roles: {} } uri = /metrics/producers
90912024-12-21T06:24:05.550ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33237 req_id = 182a9f58-9e42-47a6-b809-49a3af24c6f0 resource = Database result = Ok(()) uri = /metrics/producers
90922024-12-21T06:24:05.558ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 0816076d-2e0e-472b-89a8-a9ecbfd48b43
90932024-12-21T06:24:05.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8993 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33237 req_id = 182a9f58-9e42-47a6-b809-49a3af24c6f0 response_code = 201 uri = /metrics/producers
90942024-12-21T06:24:06.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 64613b89-2e78-4c23-a79e-863f105c27f8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90952024-12-21T06:24:06.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 64613b89-2e78-4c23-a79e-863f105c27f8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90962024-12-21T06:24:06.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1827 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 64613b89-2e78-4c23-a79e-863f105c27f8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90972024-12-21T06:24:07.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13899943-62b3-4974-b0b5-92bb68f7572a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90982024-12-21T06:24:07.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13899943-62b3-4974-b0b5-92bb68f7572a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
90992024-12-21T06:24:07.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2805 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 13899943-62b3-4974-b0b5-92bb68f7572a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91002024-12-21T06:24:07.711ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:45519
91012024-12-21T06:24:07.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45519 req_id = 57dbd47f-390d-4df1-bfea-ff8f15e0b52c roles = RoleSet { roles: {} } uri = /metrics/producers
91022024-12-21T06:24:07.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45519 req_id = 57dbd47f-390d-4df1-bfea-ff8f15e0b52c resource = Database result = Ok(()) uri = /metrics/producers
91032024-12-21T06:24:07.750ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
91042024-12-21T06:24:07.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39138 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:45519 req_id = 57dbd47f-390d-4df1-bfea-ff8f15e0b52c response_code = 201 uri = /metrics/producers
91052024-12-21T06:24:08.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 09ff40ec-993c-46a1-a1d7-ab28864c7188 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91062024-12-21T06:24:08.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 09ff40ec-993c-46a1-a1d7-ab28864c7188 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91072024-12-21T06:24:08.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 09ff40ec-993c-46a1-a1d7-ab28864c7188 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91082024-12-21T06:24:09.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 577aab80-57fd-4c98-88e8-f6804f5d3fbb roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91092024-12-21T06:24:09.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 577aab80-57fd-4c98-88e8-f6804f5d3fbb resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91102024-12-21T06:24:09.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 577aab80-57fd-4c98-88e8-f6804f5d3fbb response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91112024-12-21T06:24:10.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
91122024-12-21T06:24:10.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91132024-12-21T06:24:10.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91142024-12-21T06:24:10.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
91152024-12-21T06:24:10.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91162024-12-21T06:24:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91172024-12-21T06:24:10.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91182024-12-21T06:24:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91192024-12-21T06:24:10.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91202024-12-21T06:24:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91212024-12-21T06:24:10.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91222024-12-21T06:24:10.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91232024-12-21T06:24:10.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91242024-12-21T06:24:10.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
91252024-12-21T06:24:10.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91262024-12-21T06:24:10.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91272024-12-21T06:24:10.375ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
91282024-12-21T06:24:10.375ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.905229ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
91292024-12-21T06:24:10.381ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91302024-12-21T06:24:10.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91312024-12-21T06:24:10.410ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.493788ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91322024-12-21T06:24:10.544ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
91332024-12-21T06:24:10.545ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
91342024-12-21T06:24:10.575ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
91352024-12-21T06:24:10.576ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:54879
91362024-12-21T06:24:10.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 70a20104-b80b-4c63-839d-d01a07ad8374 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91372024-12-21T06:24:10.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54879 req_id = 7469dd70-80d8-45bd-9d99-888c55e0560b roles = RoleSet { roles: {} } uri = /metrics/producers
91382024-12-21T06:24:10.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 70a20104-b80b-4c63-839d-d01a07ad8374 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91392024-12-21T06:24:10.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54879 req_id = 7469dd70-80d8-45bd-9d99-888c55e0560b resource = Database result = Ok(()) uri = /metrics/producers
91402024-12-21T06:24:10.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 70a20104-b80b-4c63-839d-d01a07ad8374 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91412024-12-21T06:24:10.589ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
91422024-12-21T06:24:10.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13312 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:54879 req_id = 7469dd70-80d8-45bd-9d99-888c55e0560b response_code = 201 uri = /metrics/producers
91432024-12-21T06:24:10.589ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "7469dd70-80d8-45bd-9d99-888c55e0560b", "content-length": "41", "date": "Sat, 21 Dec 2024 06:24:10 GMT"} })
91442024-12-21T06:24:10.591ZDEBGnexus (producer-registration-task): registered with nexus successfully
91452024-12-21T06:24:10.591ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
91462024-12-21T06:24:11.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 42e3482b-0d49-45fe-8591-344a21049a4a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91472024-12-21T06:24:11.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 42e3482b-0d49-45fe-8591-344a21049a4a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91482024-12-21T06:24:11.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 42e3482b-0d49-45fe-8591-344a21049a4a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91492024-12-21T06:24:12.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f0dfabef-233f-4049-9a29-cb2c0c21fb96 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91502024-12-21T06:24:12.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f0dfabef-233f-4049-9a29-cb2c0c21fb96 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91512024-12-21T06:24:12.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2201 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f0dfabef-233f-4049-9a29-cb2c0c21fb96 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91522024-12-21T06:24:13.264ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33961
91532024-12-21T06:24:13.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33961 req_id = af45cfba-ac6c-41f5-ae5c-cabb5c8d8777 roles = RoleSet { roles: {} } uri = /metrics/producers
91542024-12-21T06:24:13.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33961 req_id = af45cfba-ac6c-41f5-ae5c-cabb5c8d8777 resource = Database result = Ok(()) uri = /metrics/producers
91552024-12-21T06:24:13.304ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 49f39df6-9f0d-49d5-a626-07ee31ec1ff4
91562024-12-21T06:24:13.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40754 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33961 req_id = af45cfba-ac6c-41f5-ae5c-cabb5c8d8777 response_code = 201 uri = /metrics/producers
91572024-12-21T06:24:13.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c51db92b-bbc6-4291-ac8f-df83e0440073 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91582024-12-21T06:24:13.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c51db92b-bbc6-4291-ac8f-df83e0440073 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91592024-12-21T06:24:13.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c51db92b-bbc6-4291-ac8f-df83e0440073 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91602024-12-21T06:24:13.682ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:48588
91612024-12-21T06:24:13.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48588 req_id = 11f7e0fb-87f7-446b-a636-2343a125a7c9 roles = RoleSet { roles: {} } uri = /metrics/producers
91622024-12-21T06:24:13.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48588 req_id = 11f7e0fb-87f7-446b-a636-2343a125a7c9 resource = Database result = Ok(()) uri = /metrics/producers
91632024-12-21T06:24:13.693ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 47090b0b-c8ad-4dca-92e5-38fed29ad6d5
91642024-12-21T06:24:13.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10971 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:48588 req_id = 11f7e0fb-87f7-446b-a636-2343a125a7c9 response_code = 201 uri = /metrics/producers
91652024-12-21T06:24:13.967ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1185 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 81f36399-e74f-4d11-a081-0ec5212ab737 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
91662024-12-21T06:24:14.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1d15b2cf-fced-4402-945d-7a11e46313ea roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91672024-12-21T06:24:14.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1d15b2cf-fced-4402-945d-7a11e46313ea resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91682024-12-21T06:24:14.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2477 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1d15b2cf-fced-4402-945d-7a11e46313ea response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91692024-12-21T06:24:15.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ffc1638-f3b4-4466-90df-3fa821a90dc6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91702024-12-21T06:24:15.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ffc1638-f3b4-4466-90df-3fa821a90dc6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91712024-12-21T06:24:15.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ffc1638-f3b4-4466-90df-3fa821a90dc6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91722024-12-21T06:24:16.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b9c7ce2b-90e3-4d2a-9380-68e033ac22d2 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91732024-12-21T06:24:16.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b9c7ce2b-90e3-4d2a-9380-68e033ac22d2 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91742024-12-21T06:24:16.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b9c7ce2b-90e3-4d2a-9380-68e033ac22d2 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91752024-12-21T06:24:17.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 432c4fe2-2983-49e6-b1df-858ec969bf2c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91762024-12-21T06:24:17.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 432c4fe2-2983-49e6-b1df-858ec969bf2c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91772024-12-21T06:24:17.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 432c4fe2-2983-49e6-b1df-858ec969bf2c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91782024-12-21T06:24:18.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dd01832e-f031-4466-8a2e-bf125334dddc roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91792024-12-21T06:24:18.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dd01832e-f031-4466-8a2e-bf125334dddc resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91802024-12-21T06:24:18.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dd01832e-f031-4466-8a2e-bf125334dddc response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91812024-12-21T06:24:19.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 369ac251-570d-4f66-a020-6887b6c6e0f4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91822024-12-21T06:24:19.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 369ac251-570d-4f66-a020-6887b6c6e0f4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91832024-12-21T06:24:19.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 369ac251-570d-4f66-a020-6887b6c6e0f4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
91842024-12-21T06:24:20.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
91852024-12-21T06:24:20.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91862024-12-21T06:24:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91872024-12-21T06:24:20.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
91882024-12-21T06:24:20.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91892024-12-21T06:24:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91902024-12-21T06:24:20.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91912024-12-21T06:24:20.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91922024-12-21T06:24:20.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91932024-12-21T06:24:20.354ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.672581ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91942024-12-21T06:24:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91952024-12-21T06:24:20.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91962024-12-21T06:24:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91972024-12-21T06:24:20.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91982024-12-21T06:24:20.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91992024-12-21T06:24:20.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92002024-12-21T06:24:20.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
92012024-12-21T06:24:20.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92022024-12-21T06:24:20.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92032024-12-21T06:24:20.369ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
92042024-12-21T06:24:20.369ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.191752ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
92052024-12-21T06:24:20.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e680730d-8fdf-4229-a3a8-531deeee26e3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92062024-12-21T06:24:20.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e680730d-8fdf-4229-a3a8-531deeee26e3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92072024-12-21T06:24:20.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1733 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e680730d-8fdf-4229-a3a8-531deeee26e3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92082024-12-21T06:24:21.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 765953ba-aa6d-4e6f-b4c5-1b2a2b4ac3e8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92092024-12-21T06:24:21.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 765953ba-aa6d-4e6f-b4c5-1b2a2b4ac3e8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92102024-12-21T06:24:21.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 765953ba-aa6d-4e6f-b4c5-1b2a2b4ac3e8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92112024-12-21T06:24:22.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fe5b33e8-5d3a-4a58-9306-062950f99772 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92122024-12-21T06:24:22.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fe5b33e8-5d3a-4a58-9306-062950f99772 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92132024-12-21T06:24:22.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fe5b33e8-5d3a-4a58-9306-062950f99772 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92142024-12-21T06:24:23.860ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 976605b4-a09c-4b5d-bfc6-083a20fc78ca roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92152024-12-21T06:24:23.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 976605b4-a09c-4b5d-bfc6-083a20fc78ca resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92162024-12-21T06:24:23.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 976605b4-a09c-4b5d-bfc6-083a20fc78ca response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92172024-12-21T06:24:23.967ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1198 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 7e00f358-2bae-4b19-a356-4358d44538a2 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
92182024-12-21T06:24:24.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 392eb046-c8f3-4fab-a335-3c90bd86206a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92192024-12-21T06:24:24.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 392eb046-c8f3-4fab-a335-3c90bd86206a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92202024-12-21T06:24:24.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 392eb046-c8f3-4fab-a335-3c90bd86206a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92212024-12-21T06:24:25.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 20fd1a70-a433-4ba9-9d0c-b1b4f30515e3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92222024-12-21T06:24:25.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 20fd1a70-a433-4ba9-9d0c-b1b4f30515e3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92232024-12-21T06:24:25.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 20fd1a70-a433-4ba9-9d0c-b1b4f30515e3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92242024-12-21T06:24:26.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7560fe14-61f0-4266-b059-1805868e3844 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92252024-12-21T06:24:26.926ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7560fe14-61f0-4266-b059-1805868e3844 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92262024-12-21T06:24:26.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3393 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7560fe14-61f0-4266-b059-1805868e3844 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92272024-12-21T06:24:27.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 789fb373-462d-46a1-a602-bcbb2d1c343b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92282024-12-21T06:24:27.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 789fb373-462d-46a1-a602-bcbb2d1c343b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92292024-12-21T06:24:27.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 789fb373-462d-46a1-a602-bcbb2d1c343b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92302024-12-21T06:24:28.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 7eaaa290-12dd-423e-ab1d-758bfe47c0ff roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
92312024-12-21T06:24:28.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 7eaaa290-12dd-423e-ab1d-758bfe47c0ff resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
92322024-12-21T06:24:28.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2897 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 7eaaa290-12dd-423e-ab1d-758bfe47c0ff response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
92332024-12-21T06:24:28.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 19b9207e-308b-4720-960b-fc7260dcdc34 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
92342024-12-21T06:24:28.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 19b9207e-308b-4720-960b-fc7260dcdc34 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
92352024-12-21T06:24:28.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:41441 req_id = 19b9207e-308b-4720-960b-fc7260dcdc34 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
92362024-12-21T06:24:28.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd5dc623-7ff0-4c2c-9a0f-9bd6bf2225b0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92372024-12-21T06:24:28.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd5dc623-7ff0-4c2c-9a0f-9bd6bf2225b0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92382024-12-21T06:24:28.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd5dc623-7ff0-4c2c-9a0f-9bd6bf2225b0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92392024-12-21T06:24:30.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 71ddbd7b-5f94-49e1-a524-d5901e7335fd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92402024-12-21T06:24:30.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 71ddbd7b-5f94-49e1-a524-d5901e7335fd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92412024-12-21T06:24:30.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2795 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 71ddbd7b-5f94-49e1-a524-d5901e7335fd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
92422024-12-21T06:24:30.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
92432024-12-21T06:24:30.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92442024-12-21T06:24:30.349ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
92452024-12-21T06:24:30.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
92462024-12-21T06:24:30.349ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92472024-12-21T06:24:30.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92482024-12-21T06:24:30.349ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
92492024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92502024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92512024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92522024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
92532024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
92542024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92552024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92562024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
92572024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92582024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92592024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
92602024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
92612024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92622024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92632024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
92642024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92652024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
92662024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
92672024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92682024-12-21T06:24:30.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92692024-12-21T06:24:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92702024-12-21T06:24:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92712024-12-21T06:24:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92722024-12-21T06:24:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92732024-12-21T06:24:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92742024-12-21T06:24:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92752024-12-21T06:24:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92762024-12-21T06:24:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92772024-12-21T06:24:30.352ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1601, tv_nsec: 437517221 } })
92782024-12-21T06:24:30.352ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
92792024-12-21T06:24:30.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92802024-12-21T06:24:30.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92812024-12-21T06:24:30.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92822024-12-21T06:24:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92832024-12-21T06:24:30.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92842024-12-21T06:24:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92852024-12-21T06:24:30.355ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
92862024-12-21T06:24:30.355ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92872024-12-21T06:24:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
92882024-12-21T06:24:30.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92892024-12-21T06:24:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
92902024-12-21T06:24:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
92912024-12-21T06:24:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
92922024-12-21T06:24:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
92932024-12-21T06:24:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92942024-12-21T06:24:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
92952024-12-21T06:24:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92962024-12-21T06:24:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92972024-12-21T06:24:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92982024-12-21T06:24:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92992024-12-21T06:24:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
93002024-12-21T06:24:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
93012024-12-21T06:24:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93022024-12-21T06:24:30.356ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93032024-12-21T06:24:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93042024-12-21T06:24:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93052024-12-21T06:24:30.357ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93062024-12-21T06:24:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93072024-12-21T06:24:30.358ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1601, tv_nsec: 443499037 } })
93082024-12-21T06:24:30.358ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
93092024-12-21T06:24:30.358ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.866546ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
93102024-12-21T06:24:30.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93112024-12-21T06:24:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93122024-12-21T06:24:30.364ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1601, tv_nsec: 450308866 } })
93132024-12-21T06:24:30.365ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93142024-12-21T06:24:30.365ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
93152024-12-21T06:24:30.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93162024-12-21T06:24:30.388ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93172024-12-21T06:24:30.388ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93182024-12-21T06:24:30.388ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93192024-12-21T06:24:30.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93202024-12-21T06:24:30.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93212024-12-21T06:24:30.402ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93222024-12-21T06:24:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93232024-12-21T06:24:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93242024-12-21T06:24:30.402ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93252024-12-21T06:24:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93262024-12-21T06:24:30.406ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93272024-12-21T06:24:30.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93282024-12-21T06:24:30.406ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.058945ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
93292024-12-21T06:24:30.407ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93302024-12-21T06:24:30.408ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93312024-12-21T06:24:30.408ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93322024-12-21T06:24:30.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93332024-12-21T06:24:30.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93342024-12-21T06:24:30.409ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93352024-12-21T06:24:30.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93362024-12-21T06:24:30.411ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.792976ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93372024-12-21T06:24:30.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93382024-12-21T06:24:30.411ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93392024-12-21T06:24:30.411ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93402024-12-21T06:24:30.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93412024-12-21T06:24:30.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93422024-12-21T06:24:30.412ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93432024-12-21T06:24:30.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93442024-12-21T06:24:30.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93452024-12-21T06:24:30.413ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 57.495845ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
93462024-12-21T06:24:30.414ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.503981ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93472024-12-21T06:24:30.414ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93482024-12-21T06:24:30.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93492024-12-21T06:24:30.415ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93502024-12-21T06:24:30.415ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93512024-12-21T06:24:30.415ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93522024-12-21T06:24:30.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93532024-12-21T06:24:30.416ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93542024-12-21T06:24:30.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93552024-12-21T06:24:30.416ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93562024-12-21T06:24:30.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
93572024-12-21T06:24:30.418ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93582024-12-21T06:24:30.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93592024-12-21T06:24:30.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93602024-12-21T06:24:30.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
93612024-12-21T06:24:30.419ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93622024-12-21T06:24:30.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93632024-12-21T06:24:30.421ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93642024-12-21T06:24:30.421ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 70.941928ms iteration = 22 status = 0
93652024-12-21T06:24:30.421ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93662024-12-21T06:24:30.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93672024-12-21T06:24:30.422ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93682024-12-21T06:24:30.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93692024-12-21T06:24:30.430ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
93702024-12-21T06:24:30.430ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.551695ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
93712024-12-21T06:24:30.439ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93722024-12-21T06:24:30.439ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93732024-12-21T06:24:30.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93742024-12-21T06:24:30.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93752024-12-21T06:24:30.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 84.785892ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93762024-12-21T06:24:30.455ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93772024-12-21T06:24:30.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93782024-12-21T06:24:30.458ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93792024-12-21T06:24:30.458ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 107.230014ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93802024-12-21T06:24:30.464ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
93812024-12-21T06:24:30.464ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93822024-12-21T06:24:30.464ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "179a53cb-b08a-46b6-bdde-30bb1b08d9ce", "content-length": "26", "date": "Sat, 21 Dec 2024 06:24:30 GMT"} })
93832024-12-21T06:24:30.464ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93842024-12-21T06:24:30.466ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
93852024-12-21T06:24:30.475ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93862024-12-21T06:24:30.475ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93872024-12-21T06:24:30.475ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 125.136911ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93882024-12-21T06:24:30.489ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 133.476232ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
93892024-12-21T06:24:30.517ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93902024-12-21T06:24:30.517ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93912024-12-21T06:24:30.518ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6af0a1a-fc30-4f0d-83b2-0cbda9e4442f", "content-length": "26", "date": "Sat, 21 Dec 2024 06:24:30 GMT"} })
93922024-12-21T06:24:30.518ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93932024-12-21T06:24:30.519ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93942024-12-21T06:24:30.524ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 174.16326ms iteration = 26 status = {"physical_disks_added":0}
93952024-12-21T06:24:30.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93962024-12-21T06:24:30.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93972024-12-21T06:24:30.540ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93982024-12-21T06:24:30.540ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93992024-12-21T06:24:30.540ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9c55c3d-be09-47bf-89bd-6be095121815", "content-length": "26", "date": "Sat, 21 Dec 2024 06:24:30 GMT"} })
94002024-12-21T06:24:30.540ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94012024-12-21T06:24:30.541ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94022024-12-21T06:24:30.602ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
94032024-12-21T06:24:30.602ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94042024-12-21T06:24:30.602ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9517d2fc-adcd-4136-ad06-e1888a0a2141", "content-length": "372", "date": "Sat, 21 Dec 2024 06:24:30 GMT"} })
94052024-12-21T06:24:30.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94062024-12-21T06:24:30.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94072024-12-21T06:24:30.604ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94082024-12-21T06:24:30.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94092024-12-21T06:24:30.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94102024-12-21T06:24:30.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94112024-12-21T06:24:30.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94122024-12-21T06:24:30.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94132024-12-21T06:24:30.610ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94142024-12-21T06:24:30.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94152024-12-21T06:24:30.618ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
94162024-12-21T06:24:30.618ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c23e409-633b-48bc-a895-bb731c5d4601", "content-length": "1", "date": "Sat, 21 Dec 2024 06:24:30 GMT"} })
94172024-12-21T06:24:30.620ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94182024-12-21T06:24:30.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94192024-12-21T06:24:30.622ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 273.073044ms iteration = 22 status = null
94202024-12-21T06:24:30.635ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 285.521169ms iteration = 22 status = {}
94212024-12-21T06:24:30.645ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
94222024-12-21T06:24:30.645ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
94232024-12-21T06:24:30.646ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "141bb47e-5d5c-4731-81d3-99c693e3d962", "date": "Sat, 21 Dec 2024 06:24:30 GMT"} })
94242024-12-21T06:24:30.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94252024-12-21T06:24:30.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94262024-12-21T06:24:30.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94272024-12-21T06:24:30.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94282024-12-21T06:24:30.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94292024-12-21T06:24:30.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94302024-12-21T06:24:30.679ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94312024-12-21T06:24:30.680ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "817d131f-42f7-4f62-a7ad-1d9faf48e9fa", "content-length": "691", "date": "Sat, 21 Dec 2024 06:24:30 GMT"} })
94322024-12-21T06:24:30.680ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
94332024-12-21T06:24:30.680ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
94342024-12-21T06:24:30.680ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
94352024-12-21T06:24:30.681ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 330.695091ms iteration = 22 status = {}
94362024-12-21T06:24:30.683ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
94372024-12-21T06:24:30.683ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94382024-12-21T06:24:30.683ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "eb3f48c2-6524-4758-9102-87cdc8ca6fa5", "date": "Sat, 21 Dec 2024 06:24:30 GMT"} })
94392024-12-21T06:24:30.684ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 329.208061ms iteration = 23 status = {}
94402024-12-21T06:24:30.698ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94412024-12-21T06:24:30.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94422024-12-21T06:24:30.701ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
94432024-12-21T06:24:30.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94442024-12-21T06:24:30.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94452024-12-21T06:24:30.710ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
94462024-12-21T06:24:30.710ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "05b59d0e-d22d-4915-9e20-31d520474eda", "content-length": "134", "date": "Sat, 21 Dec 2024 06:24:30 GMT"} })
94472024-12-21T06:24:30.710ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
94482024-12-21T06:24:30.710ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
94492024-12-21T06:24:30.711ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
94502024-12-21T06:24:30.711ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94512024-12-21T06:24:30.711ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94522024-12-21T06:24:30.711ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94532024-12-21T06:24:30.711ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94542024-12-21T06:24:30.711ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94552024-12-21T06:24:30.711ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94562024-12-21T06:24:30.711ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94572024-12-21T06:24:30.711ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
94582024-12-21T06:24:30.711ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94592024-12-21T06:24:30.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94602024-12-21T06:24:30.713ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
94612024-12-21T06:24:30.714ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed2f5c98-5a61-47a9-bfc7-24085bc3bee0", "content-length": "2", "date": "Sat, 21 Dec 2024 06:24:30 GMT"} })
94622024-12-21T06:24:30.714ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
94632024-12-21T06:24:30.714ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "754c8b46-431f-49a2-ac00-6ef6608fcb78", "content-length": "52", "date": "Sat, 21 Dec 2024 06:24:30 GMT"} })
94642024-12-21T06:24:30.714ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
94652024-12-21T06:24:30.714ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94662024-12-21T06:24:30.812ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "12b115aa-9fc9-4dbc-ad65-e5597e8d8c71", "date": "Sat, 21 Dec 2024 06:24:30 GMT"} })
94672024-12-21T06:24:30.812ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
94682024-12-21T06:24:30.812ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94692024-12-21T06:24:30.812ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a16265e-a04c-4c41-a5f1-4694765c3358", "content-length": "682", "date": "Sat, 21 Dec 2024 06:24:30 GMT"} })
94702024-12-21T06:24:30.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94712024-12-21T06:24:30.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94722024-12-21T06:24:30.816ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94732024-12-21T06:24:30.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94742024-12-21T06:24:30.820ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94752024-12-21T06:24:30.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94762024-12-21T06:24:30.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94772024-12-21T06:24:30.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94782024-12-21T06:24:30.829ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 478.81583ms iteration = 22 status = {}
94792024-12-21T06:24:31.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 23bb9604-bb43-47b3-843d-51baee178362 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94802024-12-21T06:24:31.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 23bb9604-bb43-47b3-843d-51baee178362 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94812024-12-21T06:24:31.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 23bb9604-bb43-47b3-843d-51baee178362 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94822024-12-21T06:24:31.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 871de8b3-f67d-4d34-8ed1-a1a077614420 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
94832024-12-21T06:24:31.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 871de8b3-f67d-4d34-8ed1-a1a077614420 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
94842024-12-21T06:24:31.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3464 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 871de8b3-f67d-4d34-8ed1-a1a077614420 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
94852024-12-21T06:24:32.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 05d2c1bc-782e-404f-a068-ad8896292a47 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94862024-12-21T06:24:32.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 05d2c1bc-782e-404f-a068-ad8896292a47 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94872024-12-21T06:24:32.057ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 05d2c1bc-782e-404f-a068-ad8896292a47 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94882024-12-21T06:24:33.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff3220ef-1cbb-4d3d-a2b3-e1c6511dfd0f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94892024-12-21T06:24:33.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff3220ef-1cbb-4d3d-a2b3-e1c6511dfd0f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94902024-12-21T06:24:33.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff3220ef-1cbb-4d3d-a2b3-e1c6511dfd0f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94912024-12-21T06:24:33.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1186 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = d733119b-080c-4220-9265-ea17cf3695cd response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
94922024-12-21T06:24:34.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9d0c93d7-b70c-4a76-942d-b105a7d8b8d8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94932024-12-21T06:24:34.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9d0c93d7-b70c-4a76-942d-b105a7d8b8d8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94942024-12-21T06:24:34.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9d0c93d7-b70c-4a76-942d-b105a7d8b8d8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94952024-12-21T06:24:35.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2f49f214-c22f-49d8-b3f6-9ddbc64e867f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94962024-12-21T06:24:35.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2f49f214-c22f-49d8-b3f6-9ddbc64e867f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94972024-12-21T06:24:35.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2f49f214-c22f-49d8-b3f6-9ddbc64e867f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94982024-12-21T06:24:36.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 641dea11-a3ed-427c-b2b3-5a21c4e51364 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
94992024-12-21T06:24:36.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 641dea11-a3ed-427c-b2b3-5a21c4e51364 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95002024-12-21T06:24:36.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 641dea11-a3ed-427c-b2b3-5a21c4e51364 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95012024-12-21T06:24:37.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4303f5b7-51fe-40f7-8969-6084ade0e1ee roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95022024-12-21T06:24:37.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4303f5b7-51fe-40f7-8969-6084ade0e1ee resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95032024-12-21T06:24:37.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4303f5b7-51fe-40f7-8969-6084ade0e1ee response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95042024-12-21T06:24:38.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 968b5e70-1f61-44dc-bebb-1dcd33fb2f4f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95052024-12-21T06:24:38.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 968b5e70-1f61-44dc-bebb-1dcd33fb2f4f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95062024-12-21T06:24:38.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 968b5e70-1f61-44dc-bebb-1dcd33fb2f4f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95072024-12-21T06:24:39.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0cbfb596-63ff-45dd-8452-5c6e997213d4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95082024-12-21T06:24:39.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0cbfb596-63ff-45dd-8452-5c6e997213d4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95092024-12-21T06:24:39.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0cbfb596-63ff-45dd-8452-5c6e997213d4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95102024-12-21T06:24:40.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8d675701-398d-4b7d-82fd-69832377e9ae roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95112024-12-21T06:24:40.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8d675701-398d-4b7d-82fd-69832377e9ae resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95122024-12-21T06:24:40.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8d675701-398d-4b7d-82fd-69832377e9ae response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95132024-12-21T06:24:40.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
95142024-12-21T06:24:40.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95152024-12-21T06:24:40.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95162024-12-21T06:24:40.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
95172024-12-21T06:24:40.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95182024-12-21T06:24:40.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95192024-12-21T06:24:40.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95202024-12-21T06:24:40.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95212024-12-21T06:24:40.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95222024-12-21T06:24:40.353ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95232024-12-21T06:24:40.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95242024-12-21T06:24:40.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95252024-12-21T06:24:40.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95262024-12-21T06:24:40.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95272024-12-21T06:24:40.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95282024-12-21T06:24:40.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
95292024-12-21T06:24:40.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95302024-12-21T06:24:40.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95312024-12-21T06:24:40.371ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
95322024-12-21T06:24:40.371ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.773493ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
95332024-12-21T06:24:40.381ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.724943ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95342024-12-21T06:24:41.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7b9ef6d-2a62-4859-9596-1107ac1388b0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95352024-12-21T06:24:41.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7b9ef6d-2a62-4859-9596-1107ac1388b0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95362024-12-21T06:24:41.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f7b9ef6d-2a62-4859-9596-1107ac1388b0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95372024-12-21T06:24:42.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 547bdd38-7030-49da-93d5-79d86079e696 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95382024-12-21T06:24:42.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 547bdd38-7030-49da-93d5-79d86079e696 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95392024-12-21T06:24:42.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 547bdd38-7030-49da-93d5-79d86079e696 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95402024-12-21T06:24:43.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4fcfd705-67f2-44c7-8410-e291c9fd9ab0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95412024-12-21T06:24:43.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4fcfd705-67f2-44c7-8410-e291c9fd9ab0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95422024-12-21T06:24:43.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2631 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4fcfd705-67f2-44c7-8410-e291c9fd9ab0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95432024-12-21T06:24:43.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1265 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 016f8714-9dc2-4fda-ba0c-2598b48fef31 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
95442024-12-21T06:24:44.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 761b52ea-dfae-4409-baf6-2dc1ead2c9fb roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95452024-12-21T06:24:44.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 761b52ea-dfae-4409-baf6-2dc1ead2c9fb resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95462024-12-21T06:24:44.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1839 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 761b52ea-dfae-4409-baf6-2dc1ead2c9fb response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95472024-12-21T06:24:45.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cd0b97f4-ff3d-4422-b79d-d96bee7e0d55 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95482024-12-21T06:24:45.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cd0b97f4-ff3d-4422-b79d-d96bee7e0d55 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95492024-12-21T06:24:45.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cd0b97f4-ff3d-4422-b79d-d96bee7e0d55 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95502024-12-21T06:24:46.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 552d2719-a2d8-4583-adeb-07a733cfa56e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95512024-12-21T06:24:46.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 552d2719-a2d8-4583-adeb-07a733cfa56e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95522024-12-21T06:24:46.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 552d2719-a2d8-4583-adeb-07a733cfa56e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95532024-12-21T06:24:47.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e8820740-e2e2-4550-abc5-24453030491e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95542024-12-21T06:24:47.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e8820740-e2e2-4550-abc5-24453030491e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95552024-12-21T06:24:47.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e8820740-e2e2-4550-abc5-24453030491e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95562024-12-21T06:24:48.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = caf59c9a-1526-40e8-9149-35b44e934d46 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95572024-12-21T06:24:48.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = caf59c9a-1526-40e8-9149-35b44e934d46 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95582024-12-21T06:24:48.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = caf59c9a-1526-40e8-9149-35b44e934d46 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95592024-12-21T06:24:49.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e4a07d7b-9a1b-4cb7-8c8a-9e4e72e3c225 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95602024-12-21T06:24:49.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e4a07d7b-9a1b-4cb7-8c8a-9e4e72e3c225 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95612024-12-21T06:24:49.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e4a07d7b-9a1b-4cb7-8c8a-9e4e72e3c225 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95622024-12-21T06:24:50.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
95632024-12-21T06:24:50.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95642024-12-21T06:24:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95652024-12-21T06:24:50.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
95662024-12-21T06:24:50.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95672024-12-21T06:24:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95682024-12-21T06:24:50.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95692024-12-21T06:24:50.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95702024-12-21T06:24:50.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95712024-12-21T06:24:50.354ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.769214ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95722024-12-21T06:24:50.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95732024-12-21T06:24:50.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95742024-12-21T06:24:50.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95752024-12-21T06:24:50.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95762024-12-21T06:24:50.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95772024-12-21T06:24:50.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95782024-12-21T06:24:50.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
95792024-12-21T06:24:50.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95802024-12-21T06:24:50.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95812024-12-21T06:24:50.369ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
95822024-12-21T06:24:50.369ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.217823ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
95832024-12-21T06:24:50.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d2ef50dc-9fd0-4996-bf45-b2d81de12ff4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95842024-12-21T06:24:50.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d2ef50dc-9fd0-4996-bf45-b2d81de12ff4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95852024-12-21T06:24:50.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d2ef50dc-9fd0-4996-bf45-b2d81de12ff4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95862024-12-21T06:24:51.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6ce64f2-d935-4c8c-b6a1-049fc346bf41 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95872024-12-21T06:24:51.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6ce64f2-d935-4c8c-b6a1-049fc346bf41 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95882024-12-21T06:24:51.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6ce64f2-d935-4c8c-b6a1-049fc346bf41 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95892024-12-21T06:24:52.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = efafe289-c10b-40af-a699-620408dd43a3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95902024-12-21T06:24:52.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = efafe289-c10b-40af-a699-620408dd43a3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95912024-12-21T06:24:52.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = efafe289-c10b-40af-a699-620408dd43a3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95922024-12-21T06:24:53.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cfe8cc6f-e81a-401a-884a-3529ee901502 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95932024-12-21T06:24:53.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cfe8cc6f-e81a-401a-884a-3529ee901502 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95942024-12-21T06:24:53.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cfe8cc6f-e81a-401a-884a-3529ee901502 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95952024-12-21T06:24:53.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1211 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 8caf0078-0886-45c3-b661-a1da764afc49 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
95962024-12-21T06:24:54.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6c940d1-8c46-49f3-bc49-e9d4d4f1d5ea roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95972024-12-21T06:24:54.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6c940d1-8c46-49f3-bc49-e9d4d4f1d5ea resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95982024-12-21T06:24:54.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6c940d1-8c46-49f3-bc49-e9d4d4f1d5ea response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
95992024-12-21T06:24:55.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c42c5c63-2642-46a4-8e3e-795d829ced4c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96002024-12-21T06:24:55.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c42c5c63-2642-46a4-8e3e-795d829ced4c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96012024-12-21T06:24:55.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c42c5c63-2642-46a4-8e3e-795d829ced4c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96022024-12-21T06:24:56.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd6398b0-c794-4588-b7fa-b36636c3490f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96032024-12-21T06:24:56.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd6398b0-c794-4588-b7fa-b36636c3490f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96042024-12-21T06:24:56.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fd6398b0-c794-4588-b7fa-b36636c3490f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96052024-12-21T06:24:57.598ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 99ae96f8-9b1e-48b8-96da-d88b28bb0b23 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96062024-12-21T06:24:57.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 99ae96f8-9b1e-48b8-96da-d88b28bb0b23 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96072024-12-21T06:24:57.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2732 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 99ae96f8-9b1e-48b8-96da-d88b28bb0b23 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96082024-12-21T06:24:58.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8b6307ad-f650-4b1c-9fef-e66193cf9fb1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96092024-12-21T06:24:58.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8b6307ad-f650-4b1c-9fef-e66193cf9fb1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96102024-12-21T06:24:58.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1835 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8b6307ad-f650-4b1c-9fef-e66193cf9fb1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96112024-12-21T06:24:59.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3e2553a1-96eb-4590-8956-faf53e29537e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96122024-12-21T06:24:59.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3e2553a1-96eb-4590-8956-faf53e29537e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96132024-12-21T06:24:59.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3e2553a1-96eb-4590-8956-faf53e29537e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
96142024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
96152024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96162024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
96172024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
96182024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
96192024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96202024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
96212024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96222024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
96232024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
96242024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96252024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
96262024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
96272024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96282024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
96292024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
96302024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
96312024-12-21T06:25:00.350ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 7c419228-2431-4394-af83-ea0457364b70
96322024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.48\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"7c419228-2431-4394-af83-ea0457364b70"}
96332024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
96342024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
96352024-12-21T06:25:00.350ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 06:15:00.350185393 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
96362024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
96372024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96382024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
96392024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
96402024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
96412024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96422024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96432024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96442024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
96452024-12-21T06:25:00.350ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
96462024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
96472024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96482024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96492024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
96502024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
96512024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96522024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
96532024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96542024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96552024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
96562024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
96572024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
96582024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
96592024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96602024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96612024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96622024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96632024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96642024-12-21T06:25:00.350ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("068965c6-3480-4953-b57e-dd969abb2a21.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("45c0a855-5592-491c-b7b3-470902319db2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1631, tv_nsec: 436111102 } })
96652024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96662024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96672024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96682024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96692024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96702024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
96712024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96722024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96732024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96742024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
96752024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96762024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96772024-12-21T06:25:00.350ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1631, tv_nsec: 436318468 } })
96782024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96792024-12-21T06:25:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96802024-12-21T06:25:00.351ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
96812024-12-21T06:25:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.233334ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
96822024-12-21T06:25:00.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96832024-12-21T06:25:00.351ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
96842024-12-21T06:25:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.220644ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
96852024-12-21T06:25:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96862024-12-21T06:25:00.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96872024-12-21T06:25:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96882024-12-21T06:25:00.352ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1631, tv_nsec: 438155919 } })
96892024-12-21T06:25:00.352ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
96902024-12-21T06:25:00.353ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.017403ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96912024-12-21T06:25:00.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96922024-12-21T06:25:00.353ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96932024-12-21T06:25:00.354ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96942024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
96952024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
96962024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96972024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96982024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
96992024-12-21T06:25:00.355ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97002024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97012024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
97022024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
97032024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
97042024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97052024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
97062024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
97072024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
97082024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
97092024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97102024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
97112024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97122024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97132024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97142024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
97152024-12-21T06:25:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
97162024-12-21T06:25:00.356ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1631, tv_nsec: 441702207 } })
97172024-12-21T06:25:00.356ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
97182024-12-21T06:25:00.357ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97192024-12-21T06:25:00.357ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97202024-12-21T06:25:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97212024-12-21T06:25:00.357ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97222024-12-21T06:25:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97232024-12-21T06:25:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97242024-12-21T06:25:00.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97252024-12-21T06:25:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97262024-12-21T06:25:00.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97272024-12-21T06:25:00.362ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97282024-12-21T06:25:00.363ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97292024-12-21T06:25:00.363ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97302024-12-21T06:25:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97312024-12-21T06:25:00.363ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 06:15:00.350185393 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
97322024-12-21T06:25:00.363ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.287528ms iteration = 12 status = {"expiration":"2024-12-21T06:15:00.350185393Z","pruned":[]}
97332024-12-21T06:25:00.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97342024-12-21T06:25:00.366ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97352024-12-21T06:25:00.366ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97362024-12-21T06:25:00.366ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97372024-12-21T06:25:00.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97382024-12-21T06:25:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
97392024-12-21T06:25:00.369ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97402024-12-21T06:25:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97412024-12-21T06:25:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97422024-12-21T06:25:00.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97432024-12-21T06:25:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97442024-12-21T06:25:00.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97452024-12-21T06:25:00.370ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97462024-12-21T06:25:00.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97472024-12-21T06:25:00.371ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97482024-12-21T06:25:00.373ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97492024-12-21T06:25:00.373ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97502024-12-21T06:25:00.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97512024-12-21T06:25:00.377ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.61017ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
97522024-12-21T06:25:00.378ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97532024-12-21T06:25:00.378ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97542024-12-21T06:25:00.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97552024-12-21T06:25:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97562024-12-21T06:25:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97572024-12-21T06:25:00.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97582024-12-21T06:25:00.379ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
97592024-12-21T06:25:00.379ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
97602024-12-21T06:25:00.379ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 23.655426ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
97612024-12-21T06:25:00.381ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97622024-12-21T06:25:00.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97632024-12-21T06:25:00.381ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97642024-12-21T06:25:00.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97652024-12-21T06:25:00.384ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97662024-12-21T06:25:00.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97672024-12-21T06:25:00.384ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1631, tv_nsec: 470212588 } })
97682024-12-21T06:25:00.385ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
97692024-12-21T06:25:00.386ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97702024-12-21T06:25:00.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97712024-12-21T06:25:00.389ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97722024-12-21T06:25:00.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97732024-12-21T06:25:00.402ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97742024-12-21T06:25:00.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97752024-12-21T06:25:00.404ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.931687ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
97762024-12-21T06:25:00.406ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97772024-12-21T06:25:00.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97782024-12-21T06:25:00.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97792024-12-21T06:25:00.408ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97802024-12-21T06:25:00.408ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.99413ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
97812024-12-21T06:25:00.408ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.194324ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97822024-12-21T06:25:00.409ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97832024-12-21T06:25:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97842024-12-21T06:25:00.409ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97852024-12-21T06:25:00.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97862024-12-21T06:25:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97872024-12-21T06:25:00.410ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97882024-12-21T06:25:00.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97892024-12-21T06:25:00.411ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97902024-12-21T06:25:00.411ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97912024-12-21T06:25:00.412ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 62.696148ms iteration = 27 status = {"physical_disks_added":0}
97922024-12-21T06:25:00.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97932024-12-21T06:25:00.413ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97942024-12-21T06:25:00.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97952024-12-21T06:25:00.414ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97962024-12-21T06:25:00.415ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
97972024-12-21T06:25:00.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97982024-12-21T06:25:00.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97992024-12-21T06:25:00.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98002024-12-21T06:25:00.418ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 68.315775ms iteration = 23 status = 0
98012024-12-21T06:25:00.419ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
98022024-12-21T06:25:00.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98032024-12-21T06:25:00.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98042024-12-21T06:25:00.424ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98052024-12-21T06:25:00.424ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 74.562428ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98062024-12-21T06:25:00.425ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98072024-12-21T06:25:00.425ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98082024-12-21T06:25:00.425ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98092024-12-21T06:25:00.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98102024-12-21T06:25:00.426ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
98112024-12-21T06:25:00.426ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
98122024-12-21T06:25:00.426ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 76.188613ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
98132024-12-21T06:25:00.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98142024-12-21T06:25:00.429ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.66577ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98152024-12-21T06:25:00.431ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
98162024-12-21T06:25:00.431ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98172024-12-21T06:25:00.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98182024-12-21T06:25:00.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98192024-12-21T06:25:00.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98202024-12-21T06:25:00.439ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
98212024-12-21T06:25:00.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
98222024-12-21T06:25:00.448ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
98232024-12-21T06:25:00.448ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
98242024-12-21T06:25:00.448ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
98252024-12-21T06:25:00.448ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98262024-12-21T06:25:00.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98272024-12-21T06:25:00.450ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98282024-12-21T06:25:00.450ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
98292024-12-21T06:25:00.450ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.284721ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
98302024-12-21T06:25:00.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98312024-12-21T06:25:00.452ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98322024-12-21T06:25:00.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98332024-12-21T06:25:00.458ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98342024-12-21T06:25:00.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98352024-12-21T06:25:00.460ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.099605ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98362024-12-21T06:25:00.462ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
98372024-12-21T06:25:00.462ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
98382024-12-21T06:25:00.462ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
98392024-12-21T06:25:00.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98402024-12-21T06:25:00.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98412024-12-21T06:25:00.463ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98422024-12-21T06:25:00.464ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98432024-12-21T06:25:00.464ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98442024-12-21T06:25:00.464ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.659869ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98452024-12-21T06:25:00.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98462024-12-21T06:25:00.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98472024-12-21T06:25:00.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98482024-12-21T06:25:00.474ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98492024-12-21T06:25:00.477ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98502024-12-21T06:25:00.477ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98512024-12-21T06:25:00.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98522024-12-21T06:25:00.477ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98532024-12-21T06:25:00.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98542024-12-21T06:25:00.491ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
98552024-12-21T06:25:00.491ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 0 version = 2
98562024-12-21T06:25:00.491ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98572024-12-21T06:25:00.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98582024-12-21T06:25:00.492ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98592024-12-21T06:25:00.495ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98602024-12-21T06:25:00.495ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98612024-12-21T06:25:00.495ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a08bdeec-0b23-4fbc-b615-578125d50470", "content-length": "26", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} })
98622024-12-21T06:25:00.495ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98632024-12-21T06:25:00.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98642024-12-21T06:25:00.496ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98652024-12-21T06:25:00.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98662024-12-21T06:25:00.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 142.395119ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
98672024-12-21T06:25:00.498ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98682024-12-21T06:25:00.498ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 1 version = 2
98692024-12-21T06:25:00.498ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98702024-12-21T06:25:00.498ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 06:14:08.776888 UTC dns_group = external generation = 2
98712024-12-21T06:25:00.498ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 148.454418ms iteration = 13 status = {"generation":2}
98722024-12-21T06:25:00.503ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
98732024-12-21T06:25:00.503ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
98742024-12-21T06:25:00.503ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98752024-12-21T06:25:00.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98762024-12-21T06:25:00.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98772024-12-21T06:25:00.506ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98782024-12-21T06:25:00.506ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98792024-12-21T06:25:00.506ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "926addfc-77d3-4d7b-b59b-257ebc03e3f3", "content-length": "26", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} })
98802024-12-21T06:25:00.506ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98812024-12-21T06:25:00.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98822024-12-21T06:25:00.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98832024-12-21T06:25:00.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98842024-12-21T06:25:00.508ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98852024-12-21T06:25:00.509ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
98862024-12-21T06:25:00.509ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
98872024-12-21T06:25:00.509ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 06:14:07.931887 UTC dns_group = internal generation = 1
98882024-12-21T06:25:00.509ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 159.71664ms iteration = 13 status = {"generation":1}
98892024-12-21T06:25:00.523ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T06:13:58.796551Z, time_modified: 2024-12-21T06:13:58.796551Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }) }
98902024-12-21T06:25:00.523ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 173.08593ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]}},"default_endpoint":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
98912024-12-21T06:25:00.532ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
98922024-12-21T06:25:00.532ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98932024-12-21T06:25:00.532ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d83c5b76-af0a-4a0f-91fb-e231f27dc10c", "content-length": "26", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} })
98942024-12-21T06:25:00.532ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98952024-12-21T06:25:00.534ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
98962024-12-21T06:25:00.538ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
98972024-12-21T06:25:00.538ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 187.939943ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
98982024-12-21T06:25:00.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98992024-12-21T06:25:00.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99002024-12-21T06:25:00.577ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99012024-12-21T06:25:00.579ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99022024-12-21T06:25:00.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99032024-12-21T06:25:00.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99042024-12-21T06:25:00.580ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99052024-12-21T06:25:00.582ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99062024-12-21T06:25:00.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99072024-12-21T06:25:00.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99082024-12-21T06:25:00.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e9d8ddc3-6ac4-4d2d-b6b3-04e98b754444 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
99092024-12-21T06:25:00.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e9d8ddc3-6ac4-4d2d-b6b3-04e98b754444 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
99102024-12-21T06:25:00.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e9d8ddc3-6ac4-4d2d-b6b3-04e98b754444 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
99112024-12-21T06:25:00.674ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99122024-12-21T06:25:00.675ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "51fd2836-fbf8-4b37-89a8-10ed9053ce02", "content-length": "1", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} })
99132024-12-21T06:25:00.676ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99142024-12-21T06:25:00.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99152024-12-21T06:25:00.678ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 328.507922ms iteration = 23 status = null
99162024-12-21T06:25:00.708ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
99172024-12-21T06:25:00.716ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 366.455914ms iteration = 23 status = {}
99182024-12-21T06:25:00.738ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
99192024-12-21T06:25:00.751ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99202024-12-21T06:25:00.751ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1734890-8994-4b4a-9127-d95040c81b2e", "content-length": "691", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} })
99212024-12-21T06:25:00.751ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
99222024-12-21T06:25:00.751ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
99232024-12-21T06:25:00.751ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
99242024-12-21T06:25:00.753ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 403.13751ms iteration = 23 status = {}
99252024-12-21T06:25:00.878ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99262024-12-21T06:25:00.878ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99272024-12-21T06:25:00.878ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4e648fe-8424-4840-a67a-24e959c8ca70", "content-length": "372", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} })
99282024-12-21T06:25:00.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99292024-12-21T06:25:00.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99302024-12-21T06:25:00.920ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
99312024-12-21T06:25:00.920ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99322024-12-21T06:25:00.921ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "954e7698-6ae1-4744-b876-53df7c06c038", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} })
99332024-12-21T06:25:00.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99342024-12-21T06:25:00.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99352024-12-21T06:25:00.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99362024-12-21T06:25:00.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99372024-12-21T06:25:00.926ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99382024-12-21T06:25:00.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99392024-12-21T06:25:00.929ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99402024-12-21T06:25:00.929ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99412024-12-21T06:25:00.930ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "54f14839-085b-49e9-8898-10c9bc197402", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} })
99422024-12-21T06:25:00.932ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 576.670854ms iteration = 24 status = {}
99432024-12-21T06:25:00.952ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99442024-12-21T06:25:00.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99452024-12-21T06:25:00.954ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
99462024-12-21T06:25:00.954ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99472024-12-21T06:25:00.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99482024-12-21T06:25:00.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99492024-12-21T06:25:00.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e4016f2-e86b-4e9d-8df9-020674e56c2f", "content-length": "134", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} })
99502024-12-21T06:25:00.964ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99512024-12-21T06:25:00.964ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
99522024-12-21T06:25:00.964ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99532024-12-21T06:25:00.964ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99542024-12-21T06:25:00.964ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99552024-12-21T06:25:00.964ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99562024-12-21T06:25:00.964ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99572024-12-21T06:25:00.964ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99582024-12-21T06:25:00.964ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99592024-12-21T06:25:00.964ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99602024-12-21T06:25:00.965ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
99612024-12-21T06:25:00.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99622024-12-21T06:25:00.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99632024-12-21T06:25:00.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99642024-12-21T06:25:00.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "257b4fd4-8699-4be1-922b-878e237ee92d", "content-length": "2", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} })
99652024-12-21T06:25:00.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99662024-12-21T06:25:00.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b615c95-927f-4167-99ac-d96ea3df8f48", "content-length": "52", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} })
99672024-12-21T06:25:00.967ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
99682024-12-21T06:25:00.967ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99692024-12-21T06:25:00.977ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
99702024-12-21T06:25:00.978ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
99712024-12-21T06:25:00.978ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "cdc7b3d3-c8a6-4828-8b2b-201972460b67", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99722024-12-21T06:25:00.978ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99732024-12-21T06:25:00.980ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ab94d2ee-57b1-4d63-9937-8b4a42dc9918", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99742024-12-21T06:25:00.980ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99752024-12-21T06:25:00.982ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99762024-12-21T06:25:00.982ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 631.985368ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
99772024-12-21T06:25:01.008ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
99782024-12-21T06:25:01.008ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "67e52c99-e60b-4314-b985-cf55cb3ac0bc", "date": "Sat, 21 Dec 2024 06:25:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
99792024-12-21T06:25:01.008ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
99802024-12-21T06:25:01.009ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9533231b-8dea-4c0f-b1ab-9fc1beda5653", "date": "Sat, 21 Dec 2024 06:25:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
99812024-12-21T06:25:01.009ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
99822024-12-21T06:25:01.011ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "33597781-3af2-40d1-96ff-c05e6603e441", "date": "Sat, 21 Dec 2024 06:25:01 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
99832024-12-21T06:25:01.011ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
99842024-12-21T06:25:01.013ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
99852024-12-21T06:25:01.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 663.76146ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
99862024-12-21T06:25:01.059ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "52023aa4-2a90-48a4-b5c4-e99bd6dec19b", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} })
99872024-12-21T06:25:01.059ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
99882024-12-21T06:25:01.059ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99892024-12-21T06:25:01.059ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1093766f-5bbd-43dd-87d2-761451a1c9ba", "content-length": "682", "date": "Sat, 21 Dec 2024 06:25:00 GMT"} })
99902024-12-21T06:25:01.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99912024-12-21T06:25:01.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99922024-12-21T06:25:01.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99932024-12-21T06:25:01.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99942024-12-21T06:25:01.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99952024-12-21T06:25:01.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99962024-12-21T06:25:01.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99972024-12-21T06:25:01.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99982024-12-21T06:25:01.076ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 725.865291ms iteration = 23 status = {}
99992024-12-21T06:25:01.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 4530d8c5-292f-44b5-8881-4540c28b8a0b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
100002024-12-21T06:25:01.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 4530d8c5-292f-44b5-8881-4540c28b8a0b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
100012024-12-21T06:25:01.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 4530d8c5-292f-44b5-8881-4540c28b8a0b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
100022024-12-21T06:25:01.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3237e7f7-878d-4d3f-b4a4-ecc93fd17d6a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100032024-12-21T06:25:01.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3237e7f7-878d-4d3f-b4a4-ecc93fd17d6a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100042024-12-21T06:25:01.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2809 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3237e7f7-878d-4d3f-b4a4-ecc93fd17d6a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100052024-12-21T06:25:02.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 99558321-f144-4f71-84f2-41cb988dc97d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100062024-12-21T06:25:02.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 99558321-f144-4f71-84f2-41cb988dc97d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100072024-12-21T06:25:02.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 99558321-f144-4f71-84f2-41cb988dc97d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100082024-12-21T06:25:03.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cc211cfe-899d-47a3-937c-8b4bfa7e32be roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100092024-12-21T06:25:03.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cc211cfe-899d-47a3-937c-8b4bfa7e32be resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100102024-12-21T06:25:03.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cc211cfe-899d-47a3-937c-8b4bfa7e32be response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100112024-12-21T06:25:03.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1287 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 220e2adf-aeb9-42a7-bddc-e0209c40bc22 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
100122024-12-21T06:25:04.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1b42055a-808e-4a18-ba38-a34c587ef611 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100132024-12-21T06:25:04.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1b42055a-808e-4a18-ba38-a34c587ef611 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100142024-12-21T06:25:04.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2648 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1b42055a-808e-4a18-ba38-a34c587ef611 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100152024-12-21T06:25:05.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fa569e50-339a-4fe5-aec2-dd0ec8b077bc roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100162024-12-21T06:25:05.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fa569e50-339a-4fe5-aec2-dd0ec8b077bc resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100172024-12-21T06:25:05.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2461 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fa569e50-339a-4fe5-aec2-dd0ec8b077bc response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100182024-12-21T06:25:06.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eef9af54-6626-4b5f-9d3c-e9c8f569e7d9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100192024-12-21T06:25:06.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eef9af54-6626-4b5f-9d3c-e9c8f569e7d9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100202024-12-21T06:25:06.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eef9af54-6626-4b5f-9d3c-e9c8f569e7d9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100212024-12-21T06:25:07.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6d271c4c-7c0d-4639-9dc1-ee5f0a5ec9cf roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100222024-12-21T06:25:07.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6d271c4c-7c0d-4639-9dc1-ee5f0a5ec9cf resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100232024-12-21T06:25:07.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6d271c4c-7c0d-4639-9dc1-ee5f0a5ec9cf response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100242024-12-21T06:25:08.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9abf37d1-d4c9-4036-8286-cf6bb14dd1d4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100252024-12-21T06:25:08.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9abf37d1-d4c9-4036-8286-cf6bb14dd1d4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100262024-12-21T06:25:08.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9abf37d1-d4c9-4036-8286-cf6bb14dd1d4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100272024-12-21T06:25:09.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d59eef1f-4586-42b1-9427-c4dd12d19a8f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100282024-12-21T06:25:09.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d59eef1f-4586-42b1-9427-c4dd12d19a8f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100292024-12-21T06:25:09.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d59eef1f-4586-42b1-9427-c4dd12d19a8f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100302024-12-21T06:25:10.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
100312024-12-21T06:25:10.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100322024-12-21T06:25:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100332024-12-21T06:25:10.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
100342024-12-21T06:25:10.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100352024-12-21T06:25:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100362024-12-21T06:25:10.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100372024-12-21T06:25:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100382024-12-21T06:25:10.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100392024-12-21T06:25:10.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100402024-12-21T06:25:10.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100412024-12-21T06:25:10.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100422024-12-21T06:25:10.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100432024-12-21T06:25:10.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
100442024-12-21T06:25:10.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100452024-12-21T06:25:10.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100462024-12-21T06:25:10.376ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
100472024-12-21T06:25:10.376ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.311719ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
100482024-12-21T06:25:10.388ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100492024-12-21T06:25:10.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100502024-12-21T06:25:10.423ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.914372ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100512024-12-21T06:25:10.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6e5e2901-6219-4d57-af36-5e5fd15b61c5 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100522024-12-21T06:25:10.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6e5e2901-6219-4d57-af36-5e5fd15b61c5 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100532024-12-21T06:25:10.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1452 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6e5e2901-6219-4d57-af36-5e5fd15b61c5 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100542024-12-21T06:25:11.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 419bffc6-5028-4d6a-982b-9289a0b0b187 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100552024-12-21T06:25:11.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 419bffc6-5028-4d6a-982b-9289a0b0b187 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100562024-12-21T06:25:11.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 419bffc6-5028-4d6a-982b-9289a0b0b187 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100572024-12-21T06:25:12.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0672e17d-3d62-4b41-8faa-6d5da185c09e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100582024-12-21T06:25:12.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0672e17d-3d62-4b41-8faa-6d5da185c09e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100592024-12-21T06:25:12.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0672e17d-3d62-4b41-8faa-6d5da185c09e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100602024-12-21T06:25:13.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8abf22ac-e9a0-42ca-b76a-f2fec0ef936c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100612024-12-21T06:25:13.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8abf22ac-e9a0-42ca-b76a-f2fec0ef936c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100622024-12-21T06:25:13.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8abf22ac-e9a0-42ca-b76a-f2fec0ef936c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100632024-12-21T06:25:13.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1292 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 00f57f6e-e2f6-4394-8a3a-1101a9f02950 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
100642024-12-21T06:25:14.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6b18c812-044e-4e9d-8cfb-4b2523dda11c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100652024-12-21T06:25:14.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6b18c812-044e-4e9d-8cfb-4b2523dda11c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100662024-12-21T06:25:14.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6b18c812-044e-4e9d-8cfb-4b2523dda11c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100672024-12-21T06:25:15.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6780ade2-6537-4e64-8122-b8bf811ca1ae roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100682024-12-21T06:25:15.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6780ade2-6537-4e64-8122-b8bf811ca1ae resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100692024-12-21T06:25:15.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1737 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6780ade2-6537-4e64-8122-b8bf811ca1ae response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100702024-12-21T06:25:17.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf0b44a6-fead-48a9-b363-e8366bc68d33 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100712024-12-21T06:25:17.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf0b44a6-fead-48a9-b363-e8366bc68d33 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100722024-12-21T06:25:17.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2261 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf0b44a6-fead-48a9-b363-e8366bc68d33 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100732024-12-21T06:25:18.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e267d27-8a23-4aa3-8ab8-5c71ef09b752 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100742024-12-21T06:25:18.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e267d27-8a23-4aa3-8ab8-5c71ef09b752 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100752024-12-21T06:25:18.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e267d27-8a23-4aa3-8ab8-5c71ef09b752 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100762024-12-21T06:25:19.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7f6b745f-110b-49dd-a03c-7638936d71e2 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100772024-12-21T06:25:19.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7f6b745f-110b-49dd-a03c-7638936d71e2 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100782024-12-21T06:25:19.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7f6b745f-110b-49dd-a03c-7638936d71e2 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100792024-12-21T06:25:20.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3f97b31d-ae17-4188-b77f-78aa733e1381 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100802024-12-21T06:25:20.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3f97b31d-ae17-4188-b77f-78aa733e1381 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100812024-12-21T06:25:20.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3f97b31d-ae17-4188-b77f-78aa733e1381 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
100822024-12-21T06:25:20.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
100832024-12-21T06:25:20.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100842024-12-21T06:25:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100852024-12-21T06:25:20.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
100862024-12-21T06:25:20.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100872024-12-21T06:25:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100882024-12-21T06:25:20.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100892024-12-21T06:25:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100902024-12-21T06:25:20.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100912024-12-21T06:25:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100922024-12-21T06:25:20.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100932024-12-21T06:25:20.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100942024-12-21T06:25:20.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100952024-12-21T06:25:20.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
100962024-12-21T06:25:20.363ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100972024-12-21T06:25:20.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100982024-12-21T06:25:20.376ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
100992024-12-21T06:25:20.376ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.402372ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
101002024-12-21T06:25:20.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 8553913f-bd9b-4dd3-8f54-29c8eca34594 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
101012024-12-21T06:25:20.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 8553913f-bd9b-4dd3-8f54-29c8eca34594 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
101022024-12-21T06:25:20.379ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101032024-12-21T06:25:20.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101042024-12-21T06:25:20.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 8553913f-bd9b-4dd3-8f54-29c8eca34594 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
101052024-12-21T06:25:20.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 3869871b-a8fb-4864-aa59-f83098fc2549 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
101062024-12-21T06:25:20.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 3869871b-a8fb-4864-aa59-f83098fc2549 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
101072024-12-21T06:25:20.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3903 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 3869871b-a8fb-4864-aa59-f83098fc2549 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
101082024-12-21T06:25:20.406ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.54999ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101092024-12-21T06:25:21.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7f87d16a-bf3b-4b0a-a107-c8c36ec0d10f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101102024-12-21T06:25:21.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7f87d16a-bf3b-4b0a-a107-c8c36ec0d10f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101112024-12-21T06:25:21.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2384 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7f87d16a-bf3b-4b0a-a107-c8c36ec0d10f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101122024-12-21T06:25:22.119ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6242b2b2-c1c8-4e75-8156-34ad9c6dfda1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101132024-12-21T06:25:22.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6242b2b2-c1c8-4e75-8156-34ad9c6dfda1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101142024-12-21T06:25:22.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2694 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6242b2b2-c1c8-4e75-8156-34ad9c6dfda1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101152024-12-21T06:25:23.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 941af007-df23-48fe-9bdb-ad328576ea11 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101162024-12-21T06:25:23.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 941af007-df23-48fe-9bdb-ad328576ea11 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101172024-12-21T06:25:23.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2705 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 941af007-df23-48fe-9bdb-ad328576ea11 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101182024-12-21T06:25:23.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1291 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 17e7c84e-e83a-424f-a032-9b174ab7b023 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
101192024-12-21T06:25:24.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 83ed11c1-cad1-4b5f-94ac-9311638ff1cf roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101202024-12-21T06:25:24.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 83ed11c1-cad1-4b5f-94ac-9311638ff1cf resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101212024-12-21T06:25:24.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 83ed11c1-cad1-4b5f-94ac-9311638ff1cf response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101222024-12-21T06:25:25.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff016341-58b6-4ba2-9862-a1c23d9ec151 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101232024-12-21T06:25:25.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff016341-58b6-4ba2-9862-a1c23d9ec151 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101242024-12-21T06:25:25.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff016341-58b6-4ba2-9862-a1c23d9ec151 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101252024-12-21T06:25:26.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78746281-1bbf-479d-91f5-7eaac0c3af56 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101262024-12-21T06:25:26.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78746281-1bbf-479d-91f5-7eaac0c3af56 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101272024-12-21T06:25:26.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 78746281-1bbf-479d-91f5-7eaac0c3af56 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101282024-12-21T06:25:27.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c300a8ef-a132-4d8a-ac0d-3cdebf9ad95e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101292024-12-21T06:25:27.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c300a8ef-a132-4d8a-ac0d-3cdebf9ad95e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101302024-12-21T06:25:27.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c300a8ef-a132-4d8a-ac0d-3cdebf9ad95e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101312024-12-21T06:25:28.068ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6048776-64c6-491b-97e9-1a8b004e1a44 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-12-21T06:25:28.060749948Z }
101322024-12-21T06:25:28.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6048776-64c6-491b-97e9-1a8b004e1a44 roles = RoleSet { roles: {} } uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
101332024-12-21T06:25:28.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6048776-64c6-491b-97e9-1a8b004e1a44 resource = Database result = Ok(()) uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
101342024-12-21T06:25:28.094ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:37713
101352024-12-21T06:25:28.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:37713 req_id = 0a5104cd-76fe-44e3-81bd-e126a1449d01 roles = RoleSet { roles: {} } uri = /metrics/producers
101362024-12-21T06:25:28.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:37713 req_id = 0a5104cd-76fe-44e3-81bd-e126a1449d01 resource = Database result = Ok(()) uri = /metrics/producers
101372024-12-21T06:25:28.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58509 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6048776-64c6-491b-97e9-1a8b004e1a44 response_code = 204 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
101382024-12-21T06:25:28.120ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5cfd9da9-e668-40c5-a926-1981655ba166 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T06:25:28.120642439Z }
101392024-12-21T06:25:28.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5cfd9da9-e668-40c5-a926-1981655ba166 roles = RoleSet { roles: {} } uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
101402024-12-21T06:25:28.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5cfd9da9-e668-40c5-a926-1981655ba166 resource = Database result = Ok(()) uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
101412024-12-21T06:25:28.130ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e
101422024-12-21T06:25:28.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35779 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:37713 req_id = 0a5104cd-76fe-44e3-81bd-e126a1449d01 response_code = 201 uri = /metrics/producers
101432024-12-21T06:25:28.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38588 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5cfd9da9-e668-40c5-a926-1981655ba166 response_code = 204 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
101442024-12-21T06:25:28.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e1821888-54a1-4ba6-a025-562888da34c7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101452024-12-21T06:25:28.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e1821888-54a1-4ba6-a025-562888da34c7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101462024-12-21T06:25:28.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e1821888-54a1-4ba6-a025-562888da34c7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101472024-12-21T06:25:29.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 42017708-b11a-451b-8fea-989cbb998c0f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101482024-12-21T06:25:29.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 42017708-b11a-451b-8fea-989cbb998c0f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101492024-12-21T06:25:29.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 42017708-b11a-451b-8fea-989cbb998c0f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101502024-12-21T06:25:30.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 14b83b88-5ff4-4de2-ba73-e207501a3d5f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101512024-12-21T06:25:30.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 14b83b88-5ff4-4de2-ba73-e207501a3d5f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101522024-12-21T06:25:30.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 14b83b88-5ff4-4de2-ba73-e207501a3d5f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
101532024-12-21T06:25:30.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
101542024-12-21T06:25:30.349ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
101552024-12-21T06:25:30.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
101562024-12-21T06:25:30.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101572024-12-21T06:25:30.349ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
101582024-12-21T06:25:30.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101592024-12-21T06:25:30.349ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
101602024-12-21T06:25:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101612024-12-21T06:25:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
101622024-12-21T06:25:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101632024-12-21T06:25:30.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
101642024-12-21T06:25:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
101652024-12-21T06:25:30.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
101662024-12-21T06:25:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101672024-12-21T06:25:30.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
101682024-12-21T06:25:30.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101692024-12-21T06:25:30.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
101702024-12-21T06:25:30.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101712024-12-21T06:25:30.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101722024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
101732024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101742024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
101752024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101762024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
101772024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
101782024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101792024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101802024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101812024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101822024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101832024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101842024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101852024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101862024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101872024-12-21T06:25:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101882024-12-21T06:25:30.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1661, tv_nsec: 438461478 } })
101892024-12-21T06:25:30.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
101902024-12-21T06:25:30.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101912024-12-21T06:25:30.353ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.650662ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
101922024-12-21T06:25:30.353ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101932024-12-21T06:25:30.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1661, tv_nsec: 439226459 } })
101942024-12-21T06:25:30.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
101952024-12-21T06:25:30.354ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101962024-12-21T06:25:30.354ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101972024-12-21T06:25:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
101982024-12-21T06:25:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101992024-12-21T06:25:30.355ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
102002024-12-21T06:25:30.355ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
102012024-12-21T06:25:30.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102022024-12-21T06:25:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
102032024-12-21T06:25:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102042024-12-21T06:25:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
102052024-12-21T06:25:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
102062024-12-21T06:25:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
102072024-12-21T06:25:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
102082024-12-21T06:25:30.356ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102092024-12-21T06:25:30.356ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102102024-12-21T06:25:30.356ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102112024-12-21T06:25:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102122024-12-21T06:25:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
102132024-12-21T06:25:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
102142024-12-21T06:25:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102152024-12-21T06:25:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102162024-12-21T06:25:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102172024-12-21T06:25:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102182024-12-21T06:25:30.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102192024-12-21T06:25:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
102202024-12-21T06:25:30.357ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102212024-12-21T06:25:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102222024-12-21T06:25:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102232024-12-21T06:25:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102242024-12-21T06:25:30.357ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102252024-12-21T06:25:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102262024-12-21T06:25:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102272024-12-21T06:25:30.357ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102282024-12-21T06:25:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102292024-12-21T06:25:30.360ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102302024-12-21T06:25:30.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
102312024-12-21T06:25:30.362ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102322024-12-21T06:25:30.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102332024-12-21T06:25:30.365ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102342024-12-21T06:25:30.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102352024-12-21T06:25:30.366ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1661, tv_nsec: 452029354 } })
102362024-12-21T06:25:30.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102372024-12-21T06:25:30.367ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102382024-12-21T06:25:30.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102392024-12-21T06:25:30.367ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
102402024-12-21T06:25:30.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102412024-12-21T06:25:30.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102422024-12-21T06:25:30.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 35.431243ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
102432024-12-21T06:25:30.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102442024-12-21T06:25:30.392ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 36.207655ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
102452024-12-21T06:25:30.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102462024-12-21T06:25:30.392ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
102472024-12-21T06:25:30.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102482024-12-21T06:25:30.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
102492024-12-21T06:25:30.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102502024-12-21T06:25:30.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102512024-12-21T06:25:30.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102522024-12-21T06:25:30.394ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102532024-12-21T06:25:30.394ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
102542024-12-21T06:25:30.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102552024-12-21T06:25:30.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102562024-12-21T06:25:30.395ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102572024-12-21T06:25:30.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102582024-12-21T06:25:30.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102592024-12-21T06:25:30.396ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102602024-12-21T06:25:30.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102612024-12-21T06:25:30.403ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102622024-12-21T06:25:30.404ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102632024-12-21T06:25:30.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102642024-12-21T06:25:30.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102652024-12-21T06:25:30.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102662024-12-21T06:25:30.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102672024-12-21T06:25:30.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102682024-12-21T06:25:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
102692024-12-21T06:25:30.407ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102702024-12-21T06:25:30.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102712024-12-21T06:25:30.429ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102722024-12-21T06:25:30.429ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102732024-12-21T06:25:30.429ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9af86267-47d6-4de1-92a4-ec0c823700e4", "content-length": "26", "date": "Sat, 21 Dec 2024 06:25:30 GMT"} })
102742024-12-21T06:25:30.429ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102752024-12-21T06:25:30.430ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
102762024-12-21T06:25:30.430ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102772024-12-21T06:25:30.430ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc96c508-3ae8-441b-ae29-a9721cdf1f53", "content-length": "26", "date": "Sat, 21 Dec 2024 06:25:30 GMT"} })
102782024-12-21T06:25:30.430ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102792024-12-21T06:25:30.431ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102802024-12-21T06:25:30.433ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102812024-12-21T06:25:30.447ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102822024-12-21T06:25:30.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102832024-12-21T06:25:30.458ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
102842024-12-21T06:25:30.458ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102852024-12-21T06:25:30.459ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb1f5003-1436-406c-b01d-19967acc54d5", "content-length": "26", "date": "Sat, 21 Dec 2024 06:25:30 GMT"} })
102862024-12-21T06:25:30.459ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102872024-12-21T06:25:30.460ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
102882024-12-21T06:25:30.467ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9/state
102892024-12-21T06:25:30.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 118.436625ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102902024-12-21T06:25:30.469ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "765e172e-eaa6-4a30-a9b7-f08af00b326e", "content-length": "130", "date": "Sat, 21 Dec 2024 06:25:30 GMT"} })
102912024-12-21T06:25:30.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102922024-12-21T06:25:30.471ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102932024-12-21T06:25:30.472ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T06:25:28.120642439Z }, migration_in: None, migration_out: None } vmm_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
102942024-12-21T06:25:30.472ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2077 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 vmm_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-12-21T06:25:28.120642439Z }
102952024-12-21T06:25:30.472ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e roles = RoleSet { roles: {} } sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 vmm_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
102962024-12-21T06:25:30.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
102972024-12-21T06:25:30.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e resource = Database result = Ok(()) sled_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63 vmm_id = d2013b0a-e7dc-4406-8397-663b3104e8b9
102982024-12-21T06:25:30.473ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102992024-12-21T06:25:30.473ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103002024-12-21T06:25:30.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103012024-12-21T06:25:30.495ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
103022024-12-21T06:25:30.498ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 145.463025ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
103032024-12-21T06:25:30.511ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 155.534474ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103042024-12-21T06:25:30.512ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 161.708085ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
103052024-12-21T06:25:30.514ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103062024-12-21T06:25:30.516ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103072024-12-21T06:25:30.516ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
103082024-12-21T06:25:30.516ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 166.009654ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
103092024-12-21T06:25:30.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
103102024-12-21T06:25:30.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103112024-12-21T06:25:30.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103122024-12-21T06:25:30.519ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 168.195945ms iteration = 24 status = 0
103132024-12-21T06:25:30.520ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 164.932624ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
103142024-12-21T06:25:30.522ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
103152024-12-21T06:25:30.523ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 172.621148ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
103162024-12-21T06:25:30.533ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 184.055255ms iteration = 24 status = {}
103172024-12-21T06:25:30.536ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103182024-12-21T06:25:30.536ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bbacb1d-9ee6-43f7-a2af-7fdf21723c9a", "content-length": "1", "date": "Sat, 21 Dec 2024 06:25:30 GMT"} })
103192024-12-21T06:25:30.538ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103202024-12-21T06:25:30.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103212024-12-21T06:25:30.540ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 190.37595ms iteration = 24 status = null
103222024-12-21T06:25:30.581ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 230.140453ms iteration = 28 status = {"physical_disks_added":0}
103232024-12-21T06:25:30.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103242024-12-21T06:25:30.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103252024-12-21T06:25:30.583ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103262024-12-21T06:25:30.585ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103272024-12-21T06:25:30.585ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103282024-12-21T06:25:30.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103292024-12-21T06:25:30.587ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103302024-12-21T06:25:30.588ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103312024-12-21T06:25:30.588ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103322024-12-21T06:25:30.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103332024-12-21T06:25:30.602ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103342024-12-21T06:25:30.602ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103352024-12-21T06:25:30.602ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba7e7928-d6c6-457e-96c9-a94c301c39c2", "content-length": "585", "date": "Sat, 21 Dec 2024 06:25:30 GMT"} })
103362024-12-21T06:25:30.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103372024-12-21T06:25:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103382024-12-21T06:25:30.634ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103392024-12-21T06:25:30.634ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1bc83de-2cdd-4536-a3d7-32a5d9427c2e", "content-length": "811", "date": "Sat, 21 Dec 2024 06:25:30 GMT"} })
103402024-12-21T06:25:30.634ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(16075393) }} sled = buskin
103412024-12-21T06:25:30.634ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
103422024-12-21T06:25:30.634ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
103432024-12-21T06:25:30.636ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 285.229961ms iteration = 24 status = {}
103442024-12-21T06:25:30.644ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103452024-12-21T06:25:30.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103462024-12-21T06:25:30.646ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {85db9cae-f931-410f-a81e-eae6fe412747: {10.151.1.175: {96ef68c5-31d1-46e5-9016-9bf0c3d2d2b7}, 10.151.1.176: {96ef68c5-31d1-46e5-9016-9bf0c3d2d2b7}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
103472024-12-21T06:25:30.646ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103482024-12-21T06:25:30.646ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
103492024-12-21T06:25:30.646ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103502024-12-21T06:25:30.646ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8fea4915-43b7-4587-b9d3-45e28f1928fc", "date": "Sat, 21 Dec 2024 06:25:30 GMT"} })
103512024-12-21T06:25:30.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103522024-12-21T06:25:30.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103532024-12-21T06:25:30.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103542024-12-21T06:25:30.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103552024-12-21T06:25:30.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103562024-12-21T06:25:30.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103572024-12-21T06:25:30.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103582024-12-21T06:25:30.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103592024-12-21T06:25:30.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103602024-12-21T06:25:30.656ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103612024-12-21T06:25:30.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103622024-12-21T06:25:30.657ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "59aa060f-b5da-4125-9c89-85d5f9320668", "content-length": "134", "date": "Sat, 21 Dec 2024 06:25:30 GMT"} })
103632024-12-21T06:25:30.657ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103642024-12-21T06:25:30.657ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
103652024-12-21T06:25:30.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103662024-12-21T06:25:30.657ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103672024-12-21T06:25:30.657ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103682024-12-21T06:25:30.657ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103692024-12-21T06:25:30.657ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103702024-12-21T06:25:30.657ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103712024-12-21T06:25:30.657ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103722024-12-21T06:25:30.657ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103732024-12-21T06:25:30.657ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103742024-12-21T06:25:30.658ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
103752024-12-21T06:25:30.658ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103762024-12-21T06:25:30.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103772024-12-21T06:25:30.659ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103782024-12-21T06:25:30.659ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f42306d4-d5d9-4ad0-9e68-e05a73bdcf28", "content-length": "2", "date": "Sat, 21 Dec 2024 06:25:30 GMT"} })
103792024-12-21T06:25:30.659ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103802024-12-21T06:25:30.660ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d542c77-b569-4f91-a896-40fecde1c14e", "content-length": "52", "date": "Sat, 21 Dec 2024 06:25:30 GMT"} })
103812024-12-21T06:25:30.660ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
103822024-12-21T06:25:30.660ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103832024-12-21T06:25:30.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103842024-12-21T06:25:30.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103852024-12-21T06:25:30.663ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103862024-12-21T06:25:30.663ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103872024-12-21T06:25:30.663ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103882024-12-21T06:25:30.753ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e35be688-73c5-47f8-9b02-3e6873921f50", "date": "Sat, 21 Dec 2024 06:25:30 GMT"} })
103892024-12-21T06:25:30.753ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
103902024-12-21T06:25:30.753ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103912024-12-21T06:25:30.753ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c658f55f-66ec-4745-9c51-05e1b16697cf", "date": "Sat, 21 Dec 2024 06:25:30 GMT"} })
103922024-12-21T06:25:30.755ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 399.299605ms iteration = 25 status = {}
103932024-12-21T06:25:30.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "50b7c7aa-e874-4d44-9a43-5b74d586e4c5", "content-length": "682", "date": "Sat, 21 Dec 2024 06:25:30 GMT"} })
103942024-12-21T06:25:30.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103952024-12-21T06:25:30.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103962024-12-21T06:25:30.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103972024-12-21T06:25:30.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103982024-12-21T06:25:30.762ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103992024-12-21T06:25:30.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104002024-12-21T06:25:30.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104012024-12-21T06:25:30.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104022024-12-21T06:25:30.772ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 421.087509ms iteration = 24 status = {}
104032024-12-21T06:25:31.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d05e6414-da8b-4ee7-993f-71e7c2567318 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104042024-12-21T06:25:31.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d05e6414-da8b-4ee7-993f-71e7c2567318 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104052024-12-21T06:25:31.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1850 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d05e6414-da8b-4ee7-993f-71e7c2567318 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104062024-12-21T06:25:32.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 690f1948-d072-4114-8ac2-8024a3b78afa roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104072024-12-21T06:25:32.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 690f1948-d072-4114-8ac2-8024a3b78afa resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104082024-12-21T06:25:32.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 690f1948-d072-4114-8ac2-8024a3b78afa response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104092024-12-21T06:25:33.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 02191a09-7158-4736-b2bb-4a518a264755 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104102024-12-21T06:25:33.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 02191a09-7158-4736-b2bb-4a518a264755 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104112024-12-21T06:25:33.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2763 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 02191a09-7158-4736-b2bb-4a518a264755 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104122024-12-21T06:25:33.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = eb008931-8cf6-4580-9d06-fea4edc1ddde response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
104132024-12-21T06:25:34.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d1766efb-16e8-4c39-844a-8dbab2fe59f0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104142024-12-21T06:25:34.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d1766efb-16e8-4c39-844a-8dbab2fe59f0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104152024-12-21T06:25:34.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2855 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d1766efb-16e8-4c39-844a-8dbab2fe59f0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104162024-12-21T06:25:35.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 56b0f17c-86e7-464a-a017-d6afe38746bc roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104172024-12-21T06:25:35.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 56b0f17c-86e7-464a-a017-d6afe38746bc resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104182024-12-21T06:25:35.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 56b0f17c-86e7-464a-a017-d6afe38746bc response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104192024-12-21T06:25:36.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7d26126a-4f25-4dcb-8d58-6ebaf7e6b1bf roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104202024-12-21T06:25:36.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7d26126a-4f25-4dcb-8d58-6ebaf7e6b1bf resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104212024-12-21T06:25:36.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7d26126a-4f25-4dcb-8d58-6ebaf7e6b1bf response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104222024-12-21T06:25:37.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 84e9f75d-73b7-4e0f-8f59-8eadc9c76e6b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104232024-12-21T06:25:37.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 84e9f75d-73b7-4e0f-8f59-8eadc9c76e6b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104242024-12-21T06:25:37.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3410 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 84e9f75d-73b7-4e0f-8f59-8eadc9c76e6b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104252024-12-21T06:25:38.215ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b5226082-34ae-4c6f-90ee-4f63440184e1 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-12-21T06:25:38.215246613Z }
104262024-12-21T06:25:38.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b5226082-34ae-4c6f-90ee-4f63440184e1 roles = RoleSet { roles: {} } uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104272024-12-21T06:25:38.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b5226082-34ae-4c6f-90ee-4f63440184e1 resource = Database result = Ok(()) uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104282024-12-21T06:25:38.287ZWARNnexus (datastore): Retryable transaction failure file = nexus/db-queries/src/transaction_retry.rs:165 retry_after (ms) = 21 transaction = vmm_and_migration_update_runtime
104292024-12-21T06:25:38.318ZINFOnexus (datastore): transaction completed attempts = 2 file = nexus/db-queries/src/transaction_retry.rs:121 transaction = vmm_and_migration_update_runtime
104302024-12-21T06:25:38.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103345 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b5226082-34ae-4c6f-90ee-4f63440184e1 response_code = 204 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104312024-12-21T06:25:38.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 991fa9b7-0db8-4edc-8064-7fef9d9954db roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104322024-12-21T06:25:38.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 991fa9b7-0db8-4edc-8064-7fef9d9954db resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104332024-12-21T06:25:38.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 991fa9b7-0db8-4edc-8064-7fef9d9954db response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104342024-12-21T06:25:39.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 0a2c5e93-753c-4797-bb67-3f7394933580 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
104352024-12-21T06:25:39.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 0a2c5e93-753c-4797-bb67-3f7394933580 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
104362024-12-21T06:25:39.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 0a2c5e93-753c-4797-bb67-3f7394933580 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
104372024-12-21T06:25:39.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 52aca69a-1f73-47d1-a9c0-8331d73333f8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
104382024-12-21T06:25:39.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 52aca69a-1f73-47d1-a9c0-8331d73333f8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
104392024-12-21T06:25:39.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3748 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 52aca69a-1f73-47d1-a9c0-8331d73333f8 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
104402024-12-21T06:25:39.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f1ec1e68-a4a3-45f0-8e73-5caf8443f0f4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104412024-12-21T06:25:39.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f1ec1e68-a4a3-45f0-8e73-5caf8443f0f4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104422024-12-21T06:25:39.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f1ec1e68-a4a3-45f0-8e73-5caf8443f0f4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104432024-12-21T06:25:40.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
104442024-12-21T06:25:40.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104452024-12-21T06:25:40.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104462024-12-21T06:25:40.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
104472024-12-21T06:25:40.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104482024-12-21T06:25:40.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104492024-12-21T06:25:40.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104502024-12-21T06:25:40.386ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104512024-12-21T06:25:40.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104522024-12-21T06:25:40.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104532024-12-21T06:25:40.388ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104542024-12-21T06:25:40.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104552024-12-21T06:25:40.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104562024-12-21T06:25:40.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104572024-12-21T06:25:40.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104582024-12-21T06:25:40.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.644187ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104592024-12-21T06:25:40.393ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
104602024-12-21T06:25:40.393ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104612024-12-21T06:25:40.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104622024-12-21T06:25:40.405ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
104632024-12-21T06:25:40.405ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.784347ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
104642024-12-21T06:25:40.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 2d470be5-a78f-4ab6-99de-fa41d1451646 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
104652024-12-21T06:25:40.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 2d470be5-a78f-4ab6-99de-fa41d1451646 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
104662024-12-21T06:25:40.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 2d470be5-a78f-4ab6-99de-fa41d1451646 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
104672024-12-21T06:25:40.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6584cb1c-f8c9-477f-88cb-cedd337fc5ab roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104682024-12-21T06:25:40.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6584cb1c-f8c9-477f-88cb-cedd337fc5ab resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104692024-12-21T06:25:40.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6584cb1c-f8c9-477f-88cb-cedd337fc5ab response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
104702024-12-21T06:25:40.744ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T06:25:40.744246892Z }
104712024-12-21T06:25:40.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 roles = RoleSet { roles: {} } uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104722024-12-21T06:25:40.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 resource = Database result = Ok(()) uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104732024-12-21T06:25:40.757ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9 vmm_needs_update = true
104742024-12-21T06:25:40.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 roles = RoleSet { roles: {} } uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104752024-12-21T06:25:40.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 resource = Database result = Ok(()) uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104762024-12-21T06:25:40.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 roles = RoleSet { roles: {} } uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104772024-12-21T06:25:40.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 resource = Database result = Ok(()) uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104782024-12-21T06:25:40.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 roles = RoleSet { roles: {} } uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104792024-12-21T06:25:40.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 resource = Database result = Ok(()) uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104802024-12-21T06:25:40.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 roles = RoleSet { roles: {} } uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104812024-12-21T06:25:40.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 resource = Database result = Ok(()) uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104822024-12-21T06:25:40.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 roles = RoleSet { roles: {} } uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104832024-12-21T06:25:40.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 resource = Database result = Ok(()) uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104842024-12-21T06:25:40.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 roles = RoleSet { roles: {} } uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104852024-12-21T06:25:40.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 resource = Database result = Ok(()) uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104862024-12-21T06:25:40.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104872024-12-21T06:25:40.771ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9fdab129-17d4-458d-9c79-06068bd8b11c, lookup_type: ById(9fdab129-17d4-458d-9c79-06068bd8b11c) }, key: 9104b877-c20d-43a9-8254-1af8d4e761c2, lookup_type: ById(9104b877-c20d-43a9-8254-1af8d4e761c2) }, key: 38a50a35-0e56-40ad-b5d5-6490bf877b4e, lookup_type: ById(38a50a35-0e56-40ad-b5d5-6490bf877b4e) } result = Ok(()) uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104882024-12-21T06:25:40.771ZINFOnexus (dropshot_internal): starting update saga for 38a50a35-0e56-40ad-b5d5-6490bf877b4e actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1544 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T06:25:40.744246892Z }
104892024-12-21T06:25:40.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27006 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 response_code = 204 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104902024-12-21T06:25:40.771ZDEBGnexus (dropshot_internal): preparing instance-update saga for 38a50a35-0e56-40ad-b5d5-6490bf877b4e... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a221958-afb5-4cb1-99b4-5437a2aa04b2 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104912024-12-21T06:25:40.771ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update
104922024-12-21T06:25:40.771ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"38a50a35-0e56-40ad-b5d5-6490bf877b4e","lookup_type":{"ById":"38a50a35-0e56-40ad-b5d5-6490bf877b4e"},"parent":{"key":"9104b877-c20d-43a9-8254-1af8d4e761c2","lookup_type":{"ById":"9104b877-c20d-43a9-8254-1af8d4e761c2"},"parent":{"key":"9fdab129-17d4-458d-9c79-06068bd8b11c","lookup_type":{"ById":"9fdab129-17d4-458d-9c79-06068bd8b11c"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
104932024-12-21T06:25:40.771ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update
104942024-12-21T06:25:40.771ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6fc4b8d6-dbe9-4d4b-9621-8c05fb9d7fc5 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-12-21T06:25:40.744246892Z }
104952024-12-21T06:25:40.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6fc4b8d6-dbe9-4d4b-9621-8c05fb9d7fc5 roles = RoleSet { roles: {} } uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104962024-12-21T06:25:40.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6fc4b8d6-dbe9-4d4b-9621-8c05fb9d7fc5 resource = Database result = Ok(()) uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104972024-12-21T06:25:40.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4040 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6fc4b8d6-dbe9-4d4b-9621-8c05fb9d7fc5 response_code = 204 uri = /vmms/d2013b0a-e7dc-4406-8397-663b3104e8b9
104982024-12-21T06:25:40.802ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update
104992024-12-21T06:25:40.802ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105002024-12-21T06:25:40.802ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105012024-12-21T06:25:40.802ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af
105022024-12-21T06:25:40.806ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105032024-12-21T06:25:40.806ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af
105042024-12-21T06:25:40.809ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105052024-12-21T06:25:40.809ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af
105062024-12-21T06:25:40.813ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105072024-12-21T06:25:40.813ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("3fda84d5-233f-47bb-bad0-4ac859956a8e")) node_id = 0 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af
105082024-12-21T06:25:40.817ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105092024-12-21T06:25:40.817ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af
105102024-12-21T06:25:40.820ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update
105112024-12-21T06:25:40.823ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105122024-12-21T06:25:40.823ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105132024-12-21T06:25:40.825ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105142024-12-21T06:25:40.825ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105152024-12-21T06:25:40.827ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105162024-12-21T06:25:40.827ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105172024-12-21T06:25:40.831ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105182024-12-21T06:25:40.831ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105192024-12-21T06:25:40.832ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105202024-12-21T06:25:40.832ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105212024-12-21T06:25:40.834ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105222024-12-21T06:25:40.834ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105232024-12-21T06:25:40.835ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105242024-12-21T06:25:40.838ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9fdab129-17d4-458d-9c79-06068bd8b11c, lookup_type: ById(9fdab129-17d4-458d-9c79-06068bd8b11c) }, key: 9104b877-c20d-43a9-8254-1af8d4e761c2, lookup_type: ById(9104b877-c20d-43a9-8254-1af8d4e761c2) }, key: 38a50a35-0e56-40ad-b5d5-6490bf877b4e, lookup_type: ById(38a50a35-0e56-40ad-b5d5-6490bf877b4e) } result = Ok(()) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105252024-12-21T06:25:40.838ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance updater_id = 3fda84d5-233f-47bb-bad0-4ac859956a8e
105262024-12-21T06:25:40.838ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105272024-12-21T06:25:40.838ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105282024-12-21T06:25:40.847ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance updater_id = 3fda84d5-233f-47bb-bad0-4ac859956a8e
105292024-12-21T06:25:40.847ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105302024-12-21T06:25:40.848ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance
105312024-12-21T06:25:40.852ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e locked_gen = Generation(Generation(2)) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = LockInstance updater_id = 3fda84d5-233f-47bb-bad0-4ac859956a8e
105322024-12-21T06:25:40.852ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105332024-12-21T06:25:40.852ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("3fda84d5-233f-47bb-bad0-4ac859956a8e")}) node_id = 1 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af
105342024-12-21T06:25:40.855ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105352024-12-21T06:25:40.855ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af
105362024-12-21T06:25:40.861ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105372024-12-21T06:25:40.862ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105382024-12-21T06:25:40.863ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105392024-12-21T06:25:40.863ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105402024-12-21T06:25:40.864ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105412024-12-21T06:25:40.865ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105422024-12-21T06:25:40.865ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105432024-12-21T06:25:40.869ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9fdab129-17d4-458d-9c79-06068bd8b11c, lookup_type: ById(9fdab129-17d4-458d-9c79-06068bd8b11c) }, key: 9104b877-c20d-43a9-8254-1af8d4e761c2, lookup_type: ById(9104b877-c20d-43a9-8254-1af8d4e761c2) }, key: 38a50a35-0e56-40ad-b5d5-6490bf877b4e, lookup_type: ById(38a50a35-0e56-40ad-b5d5-6490bf877b4e) } result = Ok(()) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105442024-12-21T06:25:40.869ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105452024-12-21T06:25:40.869ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
105462024-12-21T06:25:40.874ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: d2013b0a-e7dc-4406-8397-663b3104e8b9, time_created: 2024-12-21T06:25:19.910655Z, time_deleted: None, instance_id: 38a50a35-0e56-40ad-b5d5-6490bf877b4e, sled_id: cf7f8320-e45e-46f1-aa3b-b101ce937c63, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-12-21T06:25:40.744246Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-12-21T06:25:17.513832Z, gen: Generation(Generation(3)), propolis_id: Some(d2013b0a-e7dc-4406-8397-663b3104e8b9), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(d2013b0a-e7dc-4406-8397-663b3104e8b9 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-12-21T06:25:40.874763782Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
105472024-12-21T06:25:40.877ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
105482024-12-21T06:25:40.877ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"38a50a35-0e56-40ad-b5d5-6490bf877b4e","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"d2013b0a-e7dc-4406-8397-663b3104e8b9"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"38a50a35-0e56-40ad-b5d5-6490bf877b4e","lookup_type":{"ById":"38a50a35-0e56-40ad-b5d5-6490bf877b4e"},"parent":{"key":"9104b877-c20d-43a9-8254-1af8d4e761c2","lookup_type":{"ById":"9104b877-c20d-43a9-8254-1af8d4e761c2"},"parent":{"key":"9fdab129-17d4-458d-9c79-06068bd8b11c","lookup_type":{"ById":"9fdab129-17d4-458d-9c79-06068bd8b11c"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"3fda84d5-233f-47bb-bad0-4ac859956a8e"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"9104b877-c20d-43a9-8254-1af8d4e761c2","ram_diff":1073741824},"destroy_active_vmm":"d2013b0a-e7dc-4406-8397-663b3104e8b9","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-12-21T06:25:40.874763782Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105492024-12-21T06:25:40.877ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
105502024-12-21T06:25:40.908ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
105512024-12-21T06:25:40.908ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105522024-12-21T06:25:40.908ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105532024-12-21T06:25:40.908ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
105542024-12-21T06:25:40.912ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105552024-12-21T06:25:40.912ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
105562024-12-21T06:25:40.916ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105572024-12-21T06:25:40.916ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
105582024-12-21T06:25:40.919ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105592024-12-21T06:25:40.919ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("a4cd8393-ecce-46f0-8033-2c01408a77e3")) node_id = 0 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
105602024-12-21T06:25:40.922ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105612024-12-21T06:25:40.922ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
105622024-12-21T06:25:40.928ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e parent_lock = UpdaterLock { updater_id: 3fda84d5-233f-47bb-bad0-4ac859956a8e, locked_gen: Generation(Generation(2)) } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
105632024-12-21T06:25:40.928ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = BecomeUpdater
105642024-12-21T06:25:40.928ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = BecomeUpdater
105652024-12-21T06:25:40.941ZDEBGnexus (SagaExecutor): inherited lock from 3fda84d5-233f-47bb-bad0-4ac859956a8e to a4cd8393-ecce-46f0-8033-2c01408a77e3 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 3fda84d5-233f-47bb-bad0-4ac859956a8e saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = BecomeUpdater updater_id = a4cd8393-ecce-46f0-8033-2c01408a77e3
105662024-12-21T06:25:40.941ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
105672024-12-21T06:25:40.941ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105682024-12-21T06:25:40.941ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a4cd8393-ecce-46f0-8033-2c01408a77e3")}) node_id = 1 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
105692024-12-21T06:25:40.945ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105702024-12-21T06:25:40.945ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
105712024-12-21T06:25:40.948ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105722024-12-21T06:25:40.948ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
105732024-12-21T06:25:40.952ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
105742024-12-21T06:25:40.952ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
105752024-12-21T06:25:40.955ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
105762024-12-21T06:25:40.955ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e
105772024-12-21T06:25:40.957ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = UpdateNetworkConfig
105782024-12-21T06:25:40.957ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = UpdateNetworkConfig
105792024-12-21T06:25:40.960ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = UpdateNetworkConfig
105802024-12-21T06:25:40.960ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = UpdateNetworkConfig
105812024-12-21T06:25:40.962ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
105822024-12-21T06:25:40.962ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = UpdateNetworkConfig
105832024-12-21T06:25:40.962ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = UpdateNetworkConfig
105842024-12-21T06:25:40.965ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
105852024-12-21T06:25:40.965ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
105862024-12-21T06:25:40.965ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
105872024-12-21T06:25:40.966ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
105882024-12-21T06:25:40.967ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
105892024-12-21T06:25:40.967ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
105902024-12-21T06:25:40.968ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
105912024-12-21T06:25:40.972ZDEBGnexus: notifying dendrite of updates instance_id = Some(38a50a35-0e56-40ad-b5d5-6490bf877b4e (instance)) switch = switch0
105922024-12-21T06:25:40.972ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1672, tv_nsec: 58348500 } })
105932024-12-21T06:25:40.973ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
105942024-12-21T06:25:41.003ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
105952024-12-21T06:25:41.003ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105962024-12-21T06:25:41.004ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "643df74c-a847-4735-b998-c96178b64251", "content-length": "26", "date": "Sat, 21 Dec 2024 06:25:41 GMT"} })
105972024-12-21T06:25:41.004ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105982024-12-21T06:25:41.005ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105992024-12-21T06:25:41.034ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
106002024-12-21T06:25:41.035ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "0036b264-bf83-4ed0-a69d-c73f02e25239", "content-length": "4", "date": "Sat, 21 Dec 2024 06:25:40 GMT"} })
106012024-12-21T06:25:41.037ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106022024-12-21T06:25:41.037ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106032024-12-21T06:25:41.040ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106042024-12-21T06:25:41.040ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106052024-12-21T06:25:41.044ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
106062024-12-21T06:25:41.044ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
106072024-12-21T06:25:41.060ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-12-21T06:25:41.047001Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 9104b877-c20d-43a9-8254-1af8d4e761c2, time_modified: Some(2024-12-21T06:25:41.047001Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, time_modified: Some(2024-12-21T06:25:41.047001Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
106082024-12-21T06:25:41.060ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106092024-12-21T06:25:41.060ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106102024-12-21T06:25:41.064ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106112024-12-21T06:25:41.064ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106122024-12-21T06:25:41.067ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
106132024-12-21T06:25:41.067ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = UnassignOximeterProducer
106142024-12-21T06:25:41.068ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = UnassignOximeterProducer
106152024-12-21T06:25:41.072ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d producer_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
106162024-12-21T06:25:41.072ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = UnassignOximeterProducer
106172024-12-21T06:25:41.072ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = UnassignOximeterProducer
106182024-12-21T06:25:41.112ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
106192024-12-21T06:25:41.114ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 38a50a35-0e56-40ad-b5d5-6490bf877b4e saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/38a50a35-0e56-40ad-b5d5-6490bf877b4e
106202024-12-21T06:25:41.128ZDEBGnexus (SagaExecutor): client response oximeter-collector = 38a50a35-0e56-40ad-b5d5-6490bf877b4e result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/38a50a35-0e56-40ad-b5d5-6490bf877b4e", status: 204, headers: {"x-request-id": "5cef18cb-164f-4223-8123-b79c62841996", "date": "Sat, 21 Dec 2024 06:25:41 GMT"} }) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
106212024-12-21T06:25:41.128ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d producer_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
106222024-12-21T06:25:41.130ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106232024-12-21T06:25:41.130ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106242024-12-21T06:25:41.134ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106252024-12-21T06:25:41.134ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106262024-12-21T06:25:41.138ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e lock = UpdaterLock { updater_id: a4cd8393-ecce-46f0-8033-2c01408a77e3, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-12-21T06:25:40.874763782Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
106272024-12-21T06:25:41.138ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = CommitInstanceUpdates
106282024-12-21T06:25:41.139ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = CommitInstanceUpdates
106292024-12-21T06:25:41.179ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e new_runtime = InstanceRuntimeState { time_updated: 2024-12-21T06:25:40.874763782Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
106302024-12-21T06:25:41.179ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106312024-12-21T06:25:41.179ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106322024-12-21T06:25:41.179ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Signaled
106332024-12-21T06:25:41.179ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
106342024-12-21T06:25:41.179ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
106352024-12-21T06:25:41.179ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106362024-12-21T06:25:41.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106372024-12-21T06:25:41.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106382024-12-21T06:25:41.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106392024-12-21T06:25:41.180ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106402024-12-21T06:25:41.182ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106412024-12-21T06:25:41.182ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106422024-12-21T06:25:41.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106432024-12-21T06:25:41.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106442024-12-21T06:25:41.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106452024-12-21T06:25:41.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106462024-12-21T06:25:41.185ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106472024-12-21T06:25:41.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106482024-12-21T06:25:41.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106492024-12-21T06:25:41.186ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106502024-12-21T06:25:41.186ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("38a50a35-0e56-40ad-b5d5-6490bf877b4e"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("d2013b0a-e7dc-4406-8397-663b3104e8b9")}) node_id = 7 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106512024-12-21T06:25:41.190ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106522024-12-21T06:25:41.190ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106532024-12-21T06:25:41.194ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106542024-12-21T06:25:41.194ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106552024-12-21T06:25:41.198ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106562024-12-21T06:25:41.198ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106572024-12-21T06:25:41.201ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
106582024-12-21T06:25:41.201ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = ReleaseSledResources
106592024-12-21T06:25:41.201ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = ReleaseSledResources
106602024-12-21T06:25:41.216ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106612024-12-21T06:25:41.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106622024-12-21T06:25:41.218ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
106632024-12-21T06:25:41.218ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106642024-12-21T06:25:41.219ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a8090b7-1c49-4653-b438-64d79a8c64c0", "content-length": "372", "date": "Sat, 21 Dec 2024 06:25:41 GMT"} })
106652024-12-21T06:25:41.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106662024-12-21T06:25:41.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106672024-12-21T06:25:41.228ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106682024-12-21T06:25:41.228ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106692024-12-21T06:25:41.233ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106702024-12-21T06:25:41.233ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106712024-12-21T06:25:41.234ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {85db9cae-f931-410f-a81e-eae6fe412747: {10.151.1.175: {96ef68c5-31d1-46e5-9016-9bf0c3d2d2b7}, 10.151.1.176: {96ef68c5-31d1-46e5-9016-9bf0c3d2d2b7}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
106722024-12-21T06:25:41.234ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
106732024-12-21T06:25:41.234ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d082e9cb-476f-48ca-acc6-1eecd23eb283", "date": "Sat, 21 Dec 2024 06:25:41 GMT"} })
106742024-12-21T06:25:41.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106752024-12-21T06:25:41.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106762024-12-21T06:25:41.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106772024-12-21T06:25:41.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106782024-12-21T06:25:41.239ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e propolis_id = d2013b0a-e7dc-4406-8397-663b3104e8b9 saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
106792024-12-21T06:25:41.239ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = MarkVmmDeleted
106802024-12-21T06:25:41.239ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = MarkVmmDeleted
106812024-12-21T06:25:41.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106822024-12-21T06:25:41.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106832024-12-21T06:25:41.246ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
106842024-12-21T06:25:41.246ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106852024-12-21T06:25:41.247ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8e6f679e-085a-4692-8ecc-34f88e5e493c", "date": "Sat, 21 Dec 2024 06:25:41 GMT"} })
106862024-12-21T06:25:41.248ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 69.157988ms iteration = 26 status = {}
106872024-12-21T06:25:41.278ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106882024-12-21T06:25:41.278ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106892024-12-21T06:25:41.282ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106902024-12-21T06:25:41.282ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106912024-12-21T06:25:41.285ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106922024-12-21T06:25:41.285ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106932024-12-21T06:25:41.288ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106942024-12-21T06:25:41.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106952024-12-21T06:25:41.289ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
106962024-12-21T06:25:41.289ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
106972024-12-21T06:25:41.289ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106982024-12-21T06:25:41.291ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106992024-12-21T06:25:41.291ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107002024-12-21T06:25:41.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107012024-12-21T06:25:41.293ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = ChainSuccessorSaga
107022024-12-21T06:25:41.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107032024-12-21T06:25:41.293ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = ChainSuccessorSaga
107042024-12-21T06:25:41.294ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = ChainSuccessorSaga
107052024-12-21T06:25:41.294ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = ChainSuccessorSaga
107062024-12-21T06:25:41.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107072024-12-21T06:25:41.294ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107082024-12-21T06:25:41.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107092024-12-21T06:25:41.296ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = ChainSuccessorSaga
107102024-12-21T06:25:41.296ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = ChainSuccessorSaga
107112024-12-21T06:25:41.297ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = ChainSuccessorSaga
107122024-12-21T06:25:41.300ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 9fdab129-17d4-458d-9c79-06068bd8b11c, lookup_type: ById(9fdab129-17d4-458d-9c79-06068bd8b11c) }, key: 9104b877-c20d-43a9-8254-1af8d4e761c2, lookup_type: ById(9104b877-c20d-43a9-8254-1af8d4e761c2) }, key: 38a50a35-0e56-40ad-b5d5-6490bf877b4e, lookup_type: ById(38a50a35-0e56-40ad-b5d5-6490bf877b4e) } result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = ChainSuccessorSaga
107132024-12-21T06:25:41.300ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = ChainSuccessorSaga
107142024-12-21T06:25:41.301ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_node = ChainSuccessorSaga
107152024-12-21T06:25:41.327ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
107162024-12-21T06:25:41.327ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d505e65e-333d-4379-a62b-23ff89de1a40", "content-length": "691", "date": "Sat, 21 Dec 2024 06:25:41 GMT"} })
107172024-12-21T06:25:41.327ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
107182024-12-21T06:25:41.327ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
107192024-12-21T06:25:41.327ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
107202024-12-21T06:25:41.329ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 150.631088ms iteration = 25 status = {}
107212024-12-21T06:25:41.344ZWARNnexus (SagaExecutor): instance update: failed to start successor saga! error = failed to fetch latest snapshot for instance file = nexus/src/app/sagas/instance_update/mod.rs:1325 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update
107222024-12-21T06:25:41.344ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
107232024-12-21T06:25:41.344ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
107242024-12-21T06:25:41.344ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Signaled
107252024-12-21T06:25:41.344ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
107262024-12-21T06:25:41.344ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107272024-12-21T06:25:41.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107282024-12-21T06:25:41.346ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107292024-12-21T06:25:41.346ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
107302024-12-21T06:25:41.346ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107312024-12-21T06:25:41.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107322024-12-21T06:25:41.348ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
107332024-12-21T06:25:41.348ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
107342024-12-21T06:25:41.349ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107352024-12-21T06:25:41.349ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
107362024-12-21T06:25:41.349ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107372024-12-21T06:25:41.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107382024-12-21T06:25:41.352ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
107392024-12-21T06:25:41.352ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = cc9706a3-317f-43da-8407-21f509fcf587
107402024-12-21T06:25:41.356ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = cc9706a3-317f-43da-8407-21f509fcf587 sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
107412024-12-21T06:25:41.356ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = cc9706a3-317f-43da-8407-21f509fcf587
107422024-12-21T06:25:41.383ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107432024-12-21T06:25:41.383ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
107442024-12-21T06:25:41.383ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 39.073774ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
107452024-12-21T06:25:41.399ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
107462024-12-21T06:25:41.399ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = cc9706a3-317f-43da-8407-21f509fcf587 saga_name = instance-update saga_result = SagaResult { saga_id: cc9706a3-317f-43da-8407-21f509fcf587, saga_log: SagaLog { saga_id: cc9706a3-317f-43da-8407-21f509fcf587, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("a4cd8393-ecce-46f0-8033-2c01408a77e3")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("a4cd8393-ecce-46f0-8033-2c01408a77e3")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("38a50a35-0e56-40ad-b5d5-6490bf877b4e"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("d2013b0a-e7dc-4406-8397-663b3104e8b9")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("38a50a35-0e56-40ad-b5d5-6490bf877b4e"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("d2013b0a-e7dc-4406-8397-663b3104e8b9")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("a4cd8393-ecce-46f0-8033-2c01408a77e3"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("a4cd8393-ecce-46f0-8033-2c01408a77e3")}} }) }
107472024-12-21T06:25:41.399ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = cc9706a3-317f-43da-8407-21f509fcf587 instance_id = 38a50a35-0e56-40ad-b5d5-6490bf877b4e saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update
107482024-12-21T06:25:41.399ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
107492024-12-21T06:25:41.399ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af
107502024-12-21T06:25:41.413ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
107512024-12-21T06:25:41.413ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af
107522024-12-21T06:25:41.416ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
107532024-12-21T06:25:41.416ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af
107542024-12-21T06:25:41.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = db1d409b-3104-47a5-a39d-7c56cee22c1e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
107552024-12-21T06:25:41.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = db1d409b-3104-47a5-a39d-7c56cee22c1e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
107562024-12-21T06:25:41.421ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
107572024-12-21T06:25:41.421ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af
107582024-12-21T06:25:41.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = db1d409b-3104-47a5-a39d-7c56cee22c1e response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
107592024-12-21T06:25:41.428ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update sec_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
107602024-12-21T06:25:41.428ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af saga_name = start-instance-update saga_result = SagaResult { saga_id: cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af, saga_log: SagaLog { saga_id: cf5ed7e2-5c1f-4d89-a5c3-f768c39d82af, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("3fda84d5-233f-47bb-bad0-4ac859956a8e")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("3fda84d5-233f-47bb-bad0-4ac859956a8e")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("3fda84d5-233f-47bb-bad0-4ac859956a8e"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("3fda84d5-233f-47bb-bad0-4ac859956a8e")}} }) }
107612024-12-21T06:25:41.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3494ff59-091c-4de3-9097-a1419754fa2e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107622024-12-21T06:25:41.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3494ff59-091c-4de3-9097-a1419754fa2e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107632024-12-21T06:25:41.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3494ff59-091c-4de3-9097-a1419754fa2e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107642024-12-21T06:25:42.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ebc02c10-040d-4b36-9efb-216bbee5cb17 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107652024-12-21T06:25:42.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ebc02c10-040d-4b36-9efb-216bbee5cb17 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107662024-12-21T06:25:42.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ebc02c10-040d-4b36-9efb-216bbee5cb17 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107672024-12-21T06:25:43.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0ad67f45-0cd3-4a24-a896-14cd3fec8859 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107682024-12-21T06:25:43.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0ad67f45-0cd3-4a24-a896-14cd3fec8859 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107692024-12-21T06:25:43.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5366 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0ad67f45-0cd3-4a24-a896-14cd3fec8859 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107702024-12-21T06:25:43.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1396 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = a7d416f7-b665-488d-87de-ebb7ea4d64e3 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
107712024-12-21T06:25:44.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 14545c7d-d5d6-4b66-9abd-ba81a325dbfc roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107722024-12-21T06:25:44.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 14545c7d-d5d6-4b66-9abd-ba81a325dbfc resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107732024-12-21T06:25:44.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 14545c7d-d5d6-4b66-9abd-ba81a325dbfc response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107742024-12-21T06:25:45.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 50397f8c-a506-48a8-84dc-9f64005bf739 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107752024-12-21T06:25:45.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 50397f8c-a506-48a8-84dc-9f64005bf739 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107762024-12-21T06:25:45.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2070 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 50397f8c-a506-48a8-84dc-9f64005bf739 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107772024-12-21T06:25:46.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3ca1b4f3-0829-4e7f-900f-93f8ea60b2aa roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107782024-12-21T06:25:46.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3ca1b4f3-0829-4e7f-900f-93f8ea60b2aa resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107792024-12-21T06:25:46.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2290 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3ca1b4f3-0829-4e7f-900f-93f8ea60b2aa response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107802024-12-21T06:25:47.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d8ba3538-25e7-4d1d-94c9-dec5ca41f08f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107812024-12-21T06:25:47.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d8ba3538-25e7-4d1d-94c9-dec5ca41f08f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107822024-12-21T06:25:47.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2309 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d8ba3538-25e7-4d1d-94c9-dec5ca41f08f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107832024-12-21T06:25:48.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f83616ab-29d7-4ded-9732-4d5452503406 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107842024-12-21T06:25:48.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f83616ab-29d7-4ded-9732-4d5452503406 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107852024-12-21T06:25:48.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f83616ab-29d7-4ded-9732-4d5452503406 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107862024-12-21T06:25:49.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a90afc7b-0336-4d38-8c44-ed6c6ee7076c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107872024-12-21T06:25:49.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a90afc7b-0336-4d38-8c44-ed6c6ee7076c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107882024-12-21T06:25:49.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2320 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a90afc7b-0336-4d38-8c44-ed6c6ee7076c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
107892024-12-21T06:25:50.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
107902024-12-21T06:25:50.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107912024-12-21T06:25:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107922024-12-21T06:25:50.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
107932024-12-21T06:25:50.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107942024-12-21T06:25:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107952024-12-21T06:25:50.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107962024-12-21T06:25:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107972024-12-21T06:25:50.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107982024-12-21T06:25:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107992024-12-21T06:25:50.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108002024-12-21T06:25:50.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108012024-12-21T06:25:50.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108022024-12-21T06:25:50.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
108032024-12-21T06:25:50.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108042024-12-21T06:25:50.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108052024-12-21T06:25:50.370ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
108062024-12-21T06:25:50.370ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.654213ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
108072024-12-21T06:25:50.379ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108082024-12-21T06:25:50.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108092024-12-21T06:25:50.380ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.880786ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108102024-12-21T06:25:50.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 352b4c51-4143-4948-9528-fff534f2d377 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108112024-12-21T06:25:50.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 352b4c51-4143-4948-9528-fff534f2d377 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108122024-12-21T06:25:50.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 352b4c51-4143-4948-9528-fff534f2d377 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108132024-12-21T06:25:51.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 632d659e-89cd-40fc-80c8-3915c16b48bb roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108142024-12-21T06:25:51.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 632d659e-89cd-40fc-80c8-3915c16b48bb resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108152024-12-21T06:25:51.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 632d659e-89cd-40fc-80c8-3915c16b48bb response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108162024-12-21T06:25:52.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0c539b1d-514e-4573-9b37-9960a0ed20fa roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108172024-12-21T06:25:52.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0c539b1d-514e-4573-9b37-9960a0ed20fa resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108182024-12-21T06:25:52.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0c539b1d-514e-4573-9b37-9960a0ed20fa response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108192024-12-21T06:25:53.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a0b50fc-a317-4039-9c82-07600d86c6e9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108202024-12-21T06:25:53.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a0b50fc-a317-4039-9c82-07600d86c6e9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108212024-12-21T06:25:53.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a0b50fc-a317-4039-9c82-07600d86c6e9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108222024-12-21T06:25:53.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1379 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = cedad9e5-feea-4f84-a025-36625a4e076d response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
108232024-12-21T06:25:54.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = be37c1cf-0eda-4fdb-9955-cc9b1fa68d52 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108242024-12-21T06:25:54.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = be37c1cf-0eda-4fdb-9955-cc9b1fa68d52 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108252024-12-21T06:25:54.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = be37c1cf-0eda-4fdb-9955-cc9b1fa68d52 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108262024-12-21T06:25:55.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e49f434d-0cc5-4a88-828d-4271b1aaef40 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108272024-12-21T06:25:55.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e49f434d-0cc5-4a88-828d-4271b1aaef40 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108282024-12-21T06:25:55.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e49f434d-0cc5-4a88-828d-4271b1aaef40 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108292024-12-21T06:25:56.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bab6f364-aff4-4986-a699-e99a923ab4b6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108302024-12-21T06:25:56.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bab6f364-aff4-4986-a699-e99a923ab4b6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108312024-12-21T06:25:56.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bab6f364-aff4-4986-a699-e99a923ab4b6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108322024-12-21T06:25:57.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1a90924d-9f0c-4699-b968-433b16a3c1cc roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108332024-12-21T06:25:57.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1a90924d-9f0c-4699-b968-433b16a3c1cc resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108342024-12-21T06:25:57.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2310 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1a90924d-9f0c-4699-b968-433b16a3c1cc response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108352024-12-21T06:25:58.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 489e1230-12ff-4544-a806-3fdfe478e304 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108362024-12-21T06:25:58.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 489e1230-12ff-4544-a806-3fdfe478e304 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108372024-12-21T06:25:58.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 489e1230-12ff-4544-a806-3fdfe478e304 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108382024-12-21T06:25:59.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e854269-7c66-47b5-b16a-8c49d6e84576 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108392024-12-21T06:25:59.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e854269-7c66-47b5-b16a-8c49d6e84576 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108402024-12-21T06:25:59.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1e854269-7c66-47b5-b16a-8c49d6e84576 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
108412024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
108422024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
108432024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108442024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
108452024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
108462024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
108472024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108482024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
108492024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
108502024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
108512024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
108522024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
108532024-12-21T06:26:00.349ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 7c419228-2431-4394-af83-ea0457364b70
108542024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.15\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"7c419228-2431-4394-af83-ea0457364b70"}
108552024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
108562024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
108572024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
108582024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
108592024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
108602024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
108612024-12-21T06:26:00.349ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 06:16:00.349730341 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
108622024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
108632024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
108642024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
108652024-12-21T06:26:00.349ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
108662024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108672024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108682024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
108692024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
108702024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
108712024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
108722024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
108732024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
108742024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
108752024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
108762024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
108772024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108782024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108792024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
108802024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108812024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
108822024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108832024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
108842024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
108852024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
108862024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
108872024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108882024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
108892024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
108902024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
108912024-12-21T06:26:00.350ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
108922024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
108932024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
108942024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
108952024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
108962024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108972024-12-21T06:26:00.350ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("068965c6-3480-4953-b57e-dd969abb2a21.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("45c0a855-5592-491c-b7b3-470902319db2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1691, tv_nsec: 435761783 } })
108982024-12-21T06:26:00.350ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1691, tv_nsec: 435803764 } })
108992024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109002024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
109012024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109022024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109032024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
109042024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109052024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109062024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109072024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109082024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
109092024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
109102024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109112024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
109122024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.110511ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
109132024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109142024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109152024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
109162024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.178283ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
109172024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109182024-12-21T06:26:00.350ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109192024-12-21T06:26:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109202024-12-21T06:26:00.351ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109212024-12-21T06:26:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109222024-12-21T06:26:00.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109232024-12-21T06:26:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
109242024-12-21T06:26:00.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109252024-12-21T06:26:00.352ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109262024-12-21T06:26:00.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
109272024-12-21T06:26:00.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1691, tv_nsec: 438516579 } })
109282024-12-21T06:26:00.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
109292024-12-21T06:26:00.353ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.928369ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
109302024-12-21T06:26:00.354ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 06:16:00.349730341 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
109312024-12-21T06:26:00.354ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.876705ms iteration = 13 status = {"expiration":"2024-12-21T06:16:00.349730341Z","pruned":[]}
109322024-12-21T06:26:00.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109332024-12-21T06:26:00.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109342024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109352024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
109362024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
109372024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
109382024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
109392024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
109402024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
109412024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
109422024-12-21T06:26:00.355ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
109432024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109442024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
109452024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
109462024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
109472024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
109482024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
109492024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
109502024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
109512024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
109522024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
109532024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
109542024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
109552024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
109562024-12-21T06:26:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109572024-12-21T06:26:00.357ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109582024-12-21T06:26:00.357ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1691, tv_nsec: 442837749 } })
109592024-12-21T06:26:00.357ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
109602024-12-21T06:26:00.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109612024-12-21T06:26:00.358ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
109622024-12-21T06:26:00.358ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109632024-12-21T06:26:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109642024-12-21T06:26:00.359ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109652024-12-21T06:26:00.359ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
109662024-12-21T06:26:00.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109672024-12-21T06:26:00.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109682024-12-21T06:26:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
109692024-12-21T06:26:00.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109702024-12-21T06:26:00.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109712024-12-21T06:26:00.361ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109722024-12-21T06:26:00.362ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109732024-12-21T06:26:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
109742024-12-21T06:26:00.363ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109752024-12-21T06:26:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109762024-12-21T06:26:00.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
109772024-12-21T06:26:00.364ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
109782024-12-21T06:26:00.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
109792024-12-21T06:26:00.365ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109802024-12-21T06:26:00.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
109812024-12-21T06:26:00.368ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109822024-12-21T06:26:00.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109832024-12-21T06:26:00.368ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109842024-12-21T06:26:00.372ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
109852024-12-21T06:26:00.372ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
109862024-12-21T06:26:00.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
109872024-12-21T06:26:00.374ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109882024-12-21T06:26:00.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109892024-12-21T06:26:00.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109902024-12-21T06:26:00.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
109912024-12-21T06:26:00.379ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 24.583522ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
109922024-12-21T06:26:00.391ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109932024-12-21T06:26:00.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
109942024-12-21T06:26:00.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109952024-12-21T06:26:00.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
109962024-12-21T06:26:00.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109972024-12-21T06:26:00.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
109982024-12-21T06:26:00.408ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109992024-12-21T06:26:00.411ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110002024-12-21T06:26:00.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110012024-12-21T06:26:00.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
110022024-12-21T06:26:00.412ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110032024-12-21T06:26:00.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110042024-12-21T06:26:00.415ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110052024-12-21T06:26:00.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110062024-12-21T06:26:00.418ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110072024-12-21T06:26:00.420ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
110082024-12-21T06:26:00.421ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1691, tv_nsec: 506428652 } })
110092024-12-21T06:26:00.421ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110102024-12-21T06:26:00.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110112024-12-21T06:26:00.421ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
110122024-12-21T06:26:00.421ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110132024-12-21T06:26:00.422ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110142024-12-21T06:26:00.424ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110152024-12-21T06:26:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
110162024-12-21T06:26:00.424ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110172024-12-21T06:26:00.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110182024-12-21T06:26:00.426ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110192024-12-21T06:26:00.427ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
110202024-12-21T06:26:00.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110212024-12-21T06:26:00.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
110222024-12-21T06:26:00.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110232024-12-21T06:26:00.427ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 72.799749ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
110242024-12-21T06:26:00.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
110252024-12-21T06:26:00.428ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110262024-12-21T06:26:00.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110272024-12-21T06:26:00.429ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110282024-12-21T06:26:00.430ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110292024-12-21T06:26:00.430ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110302024-12-21T06:26:00.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110312024-12-21T06:26:00.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110322024-12-21T06:26:00.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110332024-12-21T06:26:00.430ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
110342024-12-21T06:26:00.430ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110352024-12-21T06:26:00.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110362024-12-21T06:26:00.430ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110372024-12-21T06:26:00.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110382024-12-21T06:26:00.431ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.234203ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
110392024-12-21T06:26:00.431ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
110402024-12-21T06:26:00.431ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
110412024-12-21T06:26:00.431ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 76.484781ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
110422024-12-21T06:26:00.432ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
110432024-12-21T06:26:00.432ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
110442024-12-21T06:26:00.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
110452024-12-21T06:26:00.432ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110462024-12-21T06:26:00.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110472024-12-21T06:26:00.433ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.752324ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
110482024-12-21T06:26:00.434ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110492024-12-21T06:26:00.434ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
110502024-12-21T06:26:00.434ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110512024-12-21T06:26:00.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110522024-12-21T06:26:00.434ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110532024-12-21T06:26:00.435ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
110542024-12-21T06:26:00.435ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.445009ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
110552024-12-21T06:26:00.436ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 86.317584ms iteration = 6 status = {"nsuccess":5}
110562024-12-21T06:26:00.436ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
110572024-12-21T06:26:00.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110582024-12-21T06:26:00.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110592024-12-21T06:26:00.439ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
110602024-12-21T06:26:00.439ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
110612024-12-21T06:26:00.439ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
110622024-12-21T06:26:00.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110632024-12-21T06:26:00.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110642024-12-21T06:26:00.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
110652024-12-21T06:26:00.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
110662024-12-21T06:26:00.446ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
110672024-12-21T06:26:00.446ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.9683ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
110682024-12-21T06:26:00.455ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
110692024-12-21T06:26:00.455ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
110702024-12-21T06:26:00.455ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 104.873488ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
110712024-12-21T06:26:00.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110722024-12-21T06:26:00.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110732024-12-21T06:26:00.465ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 110.111014ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
110742024-12-21T06:26:00.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110752024-12-21T06:26:00.470ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110762024-12-21T06:26:00.471ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
110772024-12-21T06:26:00.471ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
110782024-12-21T06:26:00.471ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
110792024-12-21T06:26:00.471ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110802024-12-21T06:26:00.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110812024-12-21T06:26:00.472ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 122.711153ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110822024-12-21T06:26:00.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
110832024-12-21T06:26:00.473ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110842024-12-21T06:26:00.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110852024-12-21T06:26:00.474ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
110862024-12-21T06:26:00.474ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
110872024-12-21T06:26:00.474ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.857765ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
110882024-12-21T06:26:00.475ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110892024-12-21T06:26:00.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
110902024-12-21T06:26:00.475ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110912024-12-21T06:26:00.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110922024-12-21T06:26:00.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110932024-12-21T06:26:00.476ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
110942024-12-21T06:26:00.479ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110952024-12-21T06:26:00.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110962024-12-21T06:26:00.497ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110972024-12-21T06:26:00.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110982024-12-21T06:26:00.508ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
110992024-12-21T06:26:00.521ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
111002024-12-21T06:26:00.521ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 171.28597ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
111012024-12-21T06:26:00.620ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
111022024-12-21T06:26:00.620ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d03bf611-1f15-4a7b-93d2-629f2b82e50c", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111032024-12-21T06:26:00.620ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111042024-12-21T06:26:00.622ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0152dbe7-d99d-4b04-ae72-7c8003ea1520", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111052024-12-21T06:26:00.622ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111062024-12-21T06:26:00.623ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
111072024-12-21T06:26:00.623ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111082024-12-21T06:26:00.624ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "058fb090-d755-47f5-8457-220be51cf17c", "content-length": "26", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} })
111092024-12-21T06:26:00.624ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111102024-12-21T06:26:00.624ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
111112024-12-21T06:26:00.624ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 274.75651ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
111122024-12-21T06:26:00.625ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
111132024-12-21T06:26:00.636ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
111142024-12-21T06:26:00.636ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
111152024-12-21T06:26:00.637ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9d93caa-5d09-4f01-a116-23931f459c1e", "content-length": "372", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} })
111162024-12-21T06:26:00.637ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111172024-12-21T06:26:00.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111182024-12-21T06:26:00.638ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111192024-12-21T06:26:00.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111202024-12-21T06:26:00.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111212024-12-21T06:26:00.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111222024-12-21T06:26:00.641ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 286.124546ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
111232024-12-21T06:26:00.642ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
111242024-12-21T06:26:00.642ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111252024-12-21T06:26:00.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111262024-12-21T06:26:00.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111272024-12-21T06:26:00.642ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111282024-12-21T06:26:00.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111292024-12-21T06:26:00.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111302024-12-21T06:26:00.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
111312024-12-21T06:26:00.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111322024-12-21T06:26:00.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111332024-12-21T06:26:00.648ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 298.600192ms iteration = 25 status = 0
111342024-12-21T06:26:00.656ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
111352024-12-21T06:26:00.656ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111362024-12-21T06:26:00.656ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
111372024-12-21T06:26:00.656ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
111382024-12-21T06:26:00.656ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7152d16b-65fe-4edf-9df7-0641e0e1ebf8", "content-length": "26", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} })
111392024-12-21T06:26:00.656ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111402024-12-21T06:26:00.656ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de4b980c-3342-41b7-ae8d-320be1d0cabe", "content-length": "26", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} })
111412024-12-21T06:26:00.656ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
111422024-12-21T06:26:00.657ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111432024-12-21T06:26:00.658ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
111442024-12-21T06:26:00.664ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
111452024-12-21T06:26:00.670ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
111462024-12-21T06:26:00.670ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 0 version = 2
111472024-12-21T06:26:00.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111482024-12-21T06:26:00.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111492024-12-21T06:26:00.673ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
111502024-12-21T06:26:00.673ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
111512024-12-21T06:26:00.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111522024-12-21T06:26:00.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111532024-12-21T06:26:00.673ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 323.78982ms iteration = 29 status = {"physical_disks_added":0}
111542024-12-21T06:26:00.677ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T06:13:58.796551Z, time_modified: 2024-12-21T06:13:58.796551Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
111552024-12-21T06:26:00.677ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 327.569905ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]}},"default_endpoint":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
111562024-12-21T06:26:00.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111572024-12-21T06:26:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111582024-12-21T06:26:00.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111592024-12-21T06:26:00.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111602024-12-21T06:26:00.686ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
111612024-12-21T06:26:00.686ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
111622024-12-21T06:26:00.686ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d5f5d3d7-3562-4a91-b489-4890030bb72f", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} })
111632024-12-21T06:26:00.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111642024-12-21T06:26:00.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111652024-12-21T06:26:00.686ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
111662024-12-21T06:26:00.686ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
111672024-12-21T06:26:00.686ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 06:14:07.931887 UTC dns_group = internal generation = 1
111682024-12-21T06:26:00.686ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 337.288055ms iteration = 14 status = {"generation":1}
111692024-12-21T06:26:00.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111702024-12-21T06:26:00.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111712024-12-21T06:26:00.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111722024-12-21T06:26:00.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111732024-12-21T06:26:00.695ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
111742024-12-21T06:26:00.695ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
111752024-12-21T06:26:00.695ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8a17847c-3c5c-42a7-b27a-58cdc78d86d2", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} })
111762024-12-21T06:26:00.697ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 342.253793ms iteration = 27 status = {}
111772024-12-21T06:26:00.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111782024-12-21T06:26:00.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
111792024-12-21T06:26:00.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111802024-12-21T06:26:00.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111812024-12-21T06:26:00.711ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 1 version = 2
111822024-12-21T06:26:00.711ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
111832024-12-21T06:26:00.711ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 06:14:08.776888 UTC dns_group = external generation = 2
111842024-12-21T06:26:00.711ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 362.010591ms iteration = 14 status = {"generation":2}
111852024-12-21T06:26:00.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111862024-12-21T06:26:00.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111872024-12-21T06:26:00.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111882024-12-21T06:26:00.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
111892024-12-21T06:26:00.742ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111902024-12-21T06:26:00.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111912024-12-21T06:26:00.751ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
111922024-12-21T06:26:00.751ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "65b08829-f865-429e-b922-3372882e39d2", "content-length": "2", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} })
111932024-12-21T06:26:00.753ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
111942024-12-21T06:26:00.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
111952024-12-21T06:26:00.754ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 405.043024ms iteration = 25 status = {}
111962024-12-21T06:26:00.755ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
111972024-12-21T06:26:00.755ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 405.788964ms iteration = 25 status = null
111982024-12-21T06:26:00.755ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "6edc391b-d573-4b47-9ca1-f609cda6fded", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
111992024-12-21T06:26:00.755ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
112002024-12-21T06:26:00.757ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d27808b1-e29c-4be0-aaea-4f7f8b33fc22", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
112012024-12-21T06:26:00.757ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
112022024-12-21T06:26:00.759ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "71e1de94-5568-4fab-a071-0e42a524ba59", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
112032024-12-21T06:26:00.759ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
112042024-12-21T06:26:00.761ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
112052024-12-21T06:26:00.761ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 412.142631ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
112062024-12-21T06:26:00.772ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112072024-12-21T06:26:00.774ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112082024-12-21T06:26:00.774ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112092024-12-21T06:26:00.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112102024-12-21T06:26:00.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112112024-12-21T06:26:00.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112122024-12-21T06:26:00.807ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
112132024-12-21T06:26:00.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112142024-12-21T06:26:00.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112152024-12-21T06:26:00.816ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
112162024-12-21T06:26:00.816ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3528e044-bbfd-4d4d-9c20-2f087092a43b", "content-length": "134", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} })
112172024-12-21T06:26:00.816ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
112182024-12-21T06:26:00.816ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
112192024-12-21T06:26:00.816ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
112202024-12-21T06:26:00.816ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
112212024-12-21T06:26:00.816ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112222024-12-21T06:26:00.816ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112232024-12-21T06:26:00.816ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112242024-12-21T06:26:00.816ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112252024-12-21T06:26:00.816ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
112262024-12-21T06:26:00.816ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
112272024-12-21T06:26:00.816ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
112282024-12-21T06:26:00.817ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112292024-12-21T06:26:00.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112302024-12-21T06:26:00.818ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
112312024-12-21T06:26:00.818ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf65b981-719a-4180-8a82-41708e2d199b", "content-length": "2", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} })
112322024-12-21T06:26:00.818ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
112332024-12-21T06:26:00.819ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9857c7ee-d1b8-473b-9486-e91c101201c0", "content-length": "52", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} })
112342024-12-21T06:26:00.819ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
112352024-12-21T06:26:00.819ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
112362024-12-21T06:26:00.856ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
112372024-12-21T06:26:00.917ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c939b241-51a6-46e7-aee0-fe0da24dc701", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} })
112382024-12-21T06:26:00.917ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
112392024-12-21T06:26:00.917ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
112402024-12-21T06:26:00.918ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f71b5ef1-ad27-4ad1-8b44-0e23545cdc4a", "content-length": "682", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} })
112412024-12-21T06:26:00.918ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112422024-12-21T06:26:00.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112432024-12-21T06:26:00.918ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "37e245a1-3b7e-41d4-ac31-d3189ba49bbb", "content-length": "691", "date": "Sat, 21 Dec 2024 06:26:00 GMT"} })
112442024-12-21T06:26:00.918ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
112452024-12-21T06:26:00.918ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
112462024-12-21T06:26:00.918ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
112472024-12-21T06:26:00.919ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 569.593877ms iteration = 26 status = {}
112482024-12-21T06:26:00.921ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112492024-12-21T06:26:00.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112502024-12-21T06:26:00.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112512024-12-21T06:26:00.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112522024-12-21T06:26:00.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
112532024-12-21T06:26:00.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
112542024-12-21T06:26:00.934ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 584.551883ms iteration = 25 status = {}
112552024-12-21T06:26:00.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e26c7ba6-1365-42cd-b08c-13d33d50a795 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112562024-12-21T06:26:00.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e26c7ba6-1365-42cd-b08c-13d33d50a795 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112572024-12-21T06:26:00.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e26c7ba6-1365-42cd-b08c-13d33d50a795 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112582024-12-21T06:26:01.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1d6bd8b3-1b9d-42e3-ac52-3788ec9b4cf2 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112592024-12-21T06:26:01.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1d6bd8b3-1b9d-42e3-ac52-3788ec9b4cf2 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112602024-12-21T06:26:02.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2751 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1d6bd8b3-1b9d-42e3-ac52-3788ec9b4cf2 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112612024-12-21T06:26:03.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 34223bba-7221-421e-ae2e-f6bf252d47d2 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112622024-12-21T06:26:03.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 34223bba-7221-421e-ae2e-f6bf252d47d2 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112632024-12-21T06:26:03.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2861 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 34223bba-7221-421e-ae2e-f6bf252d47d2 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112642024-12-21T06:26:03.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1308 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 4572dab0-0295-4aca-991f-c3c01fb4f22d response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
112652024-12-21T06:26:04.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d589c5d9-3c34-4855-8fe1-3a2764ae96c5 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112662024-12-21T06:26:04.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d589c5d9-3c34-4855-8fe1-3a2764ae96c5 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112672024-12-21T06:26:04.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2787 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d589c5d9-3c34-4855-8fe1-3a2764ae96c5 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112682024-12-21T06:26:05.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 37e5b319-6dab-4fb6-80c2-0443561514c4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112692024-12-21T06:26:05.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 37e5b319-6dab-4fb6-80c2-0443561514c4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112702024-12-21T06:26:05.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 37e5b319-6dab-4fb6-80c2-0443561514c4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112712024-12-21T06:26:06.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3754f508-8d08-4573-8488-e5f0a5f2b87e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112722024-12-21T06:26:06.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3754f508-8d08-4573-8488-e5f0a5f2b87e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112732024-12-21T06:26:06.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3754f508-8d08-4573-8488-e5f0a5f2b87e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112742024-12-21T06:26:07.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5918ad87-5f72-4207-b1d4-31b95ee267c1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112752024-12-21T06:26:07.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5918ad87-5f72-4207-b1d4-31b95ee267c1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112762024-12-21T06:26:07.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5918ad87-5f72-4207-b1d4-31b95ee267c1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112772024-12-21T06:26:08.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e2902bd9-d831-47e6-8fdc-104dc5e8d9a6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112782024-12-21T06:26:08.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e2902bd9-d831-47e6-8fdc-104dc5e8d9a6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112792024-12-21T06:26:08.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2576 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e2902bd9-d831-47e6-8fdc-104dc5e8d9a6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112802024-12-21T06:26:09.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ad75df39-0a9d-475d-9191-f749567f4bb1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112812024-12-21T06:26:09.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ad75df39-0a9d-475d-9191-f749567f4bb1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112822024-12-21T06:26:09.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ad75df39-0a9d-475d-9191-f749567f4bb1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112832024-12-21T06:26:10.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fcf51760-a892-4ead-8a1b-b9fdc93e2ee4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112842024-12-21T06:26:10.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fcf51760-a892-4ead-8a1b-b9fdc93e2ee4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112852024-12-21T06:26:10.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fcf51760-a892-4ead-8a1b-b9fdc93e2ee4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
112862024-12-21T06:26:10.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
112872024-12-21T06:26:10.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112882024-12-21T06:26:10.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112892024-12-21T06:26:10.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
112902024-12-21T06:26:10.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
112912024-12-21T06:26:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
112922024-12-21T06:26:10.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112932024-12-21T06:26:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112942024-12-21T06:26:10.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112952024-12-21T06:26:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112962024-12-21T06:26:10.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112972024-12-21T06:26:10.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112982024-12-21T06:26:10.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112992024-12-21T06:26:10.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
113002024-12-21T06:26:10.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113012024-12-21T06:26:10.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113022024-12-21T06:26:10.373ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
113032024-12-21T06:26:10.373ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.404826ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
113042024-12-21T06:26:10.378ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113052024-12-21T06:26:10.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113062024-12-21T06:26:10.379ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.301052ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113072024-12-21T06:26:11.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5885b4dc-0b6c-4602-903a-13fe6f24b300 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113082024-12-21T06:26:11.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5885b4dc-0b6c-4602-903a-13fe6f24b300 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113092024-12-21T06:26:11.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5885b4dc-0b6c-4602-903a-13fe6f24b300 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113102024-12-21T06:26:11.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = f489c88d-5714-4b84-8597-2d507d832a17 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
113112024-12-21T06:26:11.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = f489c88d-5714-4b84-8597-2d507d832a17 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
113122024-12-21T06:26:11.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = f489c88d-5714-4b84-8597-2d507d832a17 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
113132024-12-21T06:26:12.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 911f8e4b-087e-4fe4-bebb-c416ca5def76 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113142024-12-21T06:26:12.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 911f8e4b-087e-4fe4-bebb-c416ca5def76 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113152024-12-21T06:26:12.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2232 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 911f8e4b-087e-4fe4-bebb-c416ca5def76 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113162024-12-21T06:26:13.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b374c962-495b-4248-bd2e-a97b35353928 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113172024-12-21T06:26:13.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b374c962-495b-4248-bd2e-a97b35353928 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113182024-12-21T06:26:13.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2661 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b374c962-495b-4248-bd2e-a97b35353928 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113192024-12-21T06:26:13.967ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1232 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 175d7244-2463-4f8a-9e52-baaed269f5f0 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
113202024-12-21T06:26:14.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9094e07d-b6c1-4ef4-ba77-12638e8c0733 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113212024-12-21T06:26:14.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9094e07d-b6c1-4ef4-ba77-12638e8c0733 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113222024-12-21T06:26:14.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9094e07d-b6c1-4ef4-ba77-12638e8c0733 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113232024-12-21T06:26:15.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8a6a1108-489a-44b8-b7e4-184578c95bc8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113242024-12-21T06:26:15.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8a6a1108-489a-44b8-b7e4-184578c95bc8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113252024-12-21T06:26:15.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8a6a1108-489a-44b8-b7e4-184578c95bc8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113262024-12-21T06:26:16.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 44c311a3-e3ab-491e-90c3-3165804047e1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113272024-12-21T06:26:16.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 44c311a3-e3ab-491e-90c3-3165804047e1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113282024-12-21T06:26:16.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 44c311a3-e3ab-491e-90c3-3165804047e1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113292024-12-21T06:26:17.328ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 569f9f05-4dae-4218-9c27-c7be4cadff41 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113302024-12-21T06:26:17.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 569f9f05-4dae-4218-9c27-c7be4cadff41 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113312024-12-21T06:26:17.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 569f9f05-4dae-4218-9c27-c7be4cadff41 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113322024-12-21T06:26:18.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3c5f2e9a-34a7-4fb9-9774-6294ee8e7b09 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113332024-12-21T06:26:18.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3c5f2e9a-34a7-4fb9-9774-6294ee8e7b09 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113342024-12-21T06:26:18.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3c5f2e9a-34a7-4fb9-9774-6294ee8e7b09 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113352024-12-21T06:26:19.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ceb76fed-9300-4ee9-a457-4343ec54e681 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113362024-12-21T06:26:19.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ceb76fed-9300-4ee9-a457-4343ec54e681 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113372024-12-21T06:26:19.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ceb76fed-9300-4ee9-a457-4343ec54e681 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113382024-12-21T06:26:20.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
113392024-12-21T06:26:20.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113402024-12-21T06:26:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113412024-12-21T06:26:20.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
113422024-12-21T06:26:20.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113432024-12-21T06:26:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113442024-12-21T06:26:20.378ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113452024-12-21T06:26:20.381ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
113462024-12-21T06:26:20.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
113472024-12-21T06:26:20.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113482024-12-21T06:26:20.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113492024-12-21T06:26:20.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
113502024-12-21T06:26:20.383ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.186461ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
113512024-12-21T06:26:20.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113522024-12-21T06:26:20.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113532024-12-21T06:26:20.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113542024-12-21T06:26:20.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
113552024-12-21T06:26:20.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113562024-12-21T06:26:20.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113572024-12-21T06:26:20.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8bf8619e-4991-4992-af42-7cc25c57977f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113582024-12-21T06:26:20.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8bf8619e-4991-4992-af42-7cc25c57977f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113592024-12-21T06:26:20.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1730 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8bf8619e-4991-4992-af42-7cc25c57977f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113602024-12-21T06:26:20.399ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
113612024-12-21T06:26:20.399ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.807441ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
113622024-12-21T06:26:21.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26fe5806-2ac9-4845-a121-56d91fa89d4b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113632024-12-21T06:26:21.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26fe5806-2ac9-4845-a121-56d91fa89d4b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113642024-12-21T06:26:21.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 26fe5806-2ac9-4845-a121-56d91fa89d4b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113652024-12-21T06:26:22.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 97cb2425-4aa6-4ebe-a7e2-3a8321de3d63 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113662024-12-21T06:26:22.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 97cb2425-4aa6-4ebe-a7e2-3a8321de3d63 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113672024-12-21T06:26:22.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 97cb2425-4aa6-4ebe-a7e2-3a8321de3d63 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113682024-12-21T06:26:23.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d9260ef0-fc31-43d6-819f-941e8c27807d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113692024-12-21T06:26:23.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d9260ef0-fc31-43d6-819f-941e8c27807d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113702024-12-21T06:26:23.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2003 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d9260ef0-fc31-43d6-819f-941e8c27807d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113712024-12-21T06:26:23.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1368 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = debff18c-ee6f-4fec-806b-fe7c76835ad4 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
113722024-12-21T06:26:24.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 911e4d16-14d8-4cff-8d66-70689de444b4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113732024-12-21T06:26:24.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 911e4d16-14d8-4cff-8d66-70689de444b4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113742024-12-21T06:26:24.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 911e4d16-14d8-4cff-8d66-70689de444b4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113752024-12-21T06:26:25.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0ae11bed-7400-49c6-b7b3-f097eb4a34e6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113762024-12-21T06:26:25.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0ae11bed-7400-49c6-b7b3-f097eb4a34e6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113772024-12-21T06:26:25.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2690 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0ae11bed-7400-49c6-b7b3-f097eb4a34e6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113782024-12-21T06:26:26.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1f4ced24-c770-4b2e-981c-524d5a97c211 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113792024-12-21T06:26:26.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1f4ced24-c770-4b2e-981c-524d5a97c211 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113802024-12-21T06:26:26.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1f4ced24-c770-4b2e-981c-524d5a97c211 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113812024-12-21T06:26:27.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fc0f5578-7227-47dd-b0b5-c4a576f676e0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113822024-12-21T06:26:27.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fc0f5578-7227-47dd-b0b5-c4a576f676e0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113832024-12-21T06:26:27.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3367 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = fc0f5578-7227-47dd-b0b5-c4a576f676e0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113842024-12-21T06:26:28.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2ceffe3b-a0b1-4f03-a8ba-2f54f5c879ad roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113852024-12-21T06:26:28.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2ceffe3b-a0b1-4f03-a8ba-2f54f5c879ad resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113862024-12-21T06:26:28.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1998 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2ceffe3b-a0b1-4f03-a8ba-2f54f5c879ad response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113872024-12-21T06:26:29.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 41f3f51f-d8b7-4a21-b97e-cd322baa8bdc roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113882024-12-21T06:26:29.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 41f3f51f-d8b7-4a21-b97e-cd322baa8bdc resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113892024-12-21T06:26:29.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 41f3f51f-d8b7-4a21-b97e-cd322baa8bdc response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
113902024-12-21T06:26:30.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
113912024-12-21T06:26:30.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
113922024-12-21T06:26:30.349ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
113932024-12-21T06:26:30.349ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
113942024-12-21T06:26:30.349ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
113952024-12-21T06:26:30.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
113962024-12-21T06:26:30.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113972024-12-21T06:26:30.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
113982024-12-21T06:26:30.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113992024-12-21T06:26:30.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
114002024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
114012024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
114022024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114032024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
114042024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114052024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114062024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
114072024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
114082024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
114092024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
114102024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114112024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114122024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
114132024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114142024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
114152024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
114162024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114172024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
114182024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114192024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
114202024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114212024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114222024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114232024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114242024-12-21T06:26:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114252024-12-21T06:26:30.351ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1721, tv_nsec: 437374157 } })
114262024-12-21T06:26:30.352ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
114272024-12-21T06:26:30.352ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114282024-12-21T06:26:30.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1721, tv_nsec: 438820557 } })
114292024-12-21T06:26:30.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
114302024-12-21T06:26:30.353ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.31478ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
114312024-12-21T06:26:30.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
114322024-12-21T06:26:30.354ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
114332024-12-21T06:26:30.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
114342024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
114352024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
114362024-12-21T06:26:30.355ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
114372024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
114382024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114392024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
114402024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114412024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
114422024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
114432024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
114442024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
114452024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114462024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
114472024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
114482024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114492024-12-21T06:26:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
114502024-12-21T06:26:30.356ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114512024-12-21T06:26:30.356ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114522024-12-21T06:26:30.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
114532024-12-21T06:26:30.359ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114542024-12-21T06:26:30.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114552024-12-21T06:26:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
114562024-12-21T06:26:30.360ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114572024-12-21T06:26:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114582024-12-21T06:26:30.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114592024-12-21T06:26:30.366ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114602024-12-21T06:26:30.366ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114612024-12-21T06:26:30.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114622024-12-21T06:26:30.366ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
114632024-12-21T06:26:30.366ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114642024-12-21T06:26:30.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
114652024-12-21T06:26:30.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114662024-12-21T06:26:30.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114672024-12-21T06:26:30.374ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
114682024-12-21T06:26:30.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114692024-12-21T06:26:30.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114702024-12-21T06:26:30.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114712024-12-21T06:26:30.394ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114722024-12-21T06:26:30.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114732024-12-21T06:26:30.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114742024-12-21T06:26:30.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114752024-12-21T06:26:30.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
114762024-12-21T06:26:30.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114772024-12-21T06:26:30.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114782024-12-21T06:26:30.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114792024-12-21T06:26:30.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114802024-12-21T06:26:30.398ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114812024-12-21T06:26:30.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114822024-12-21T06:26:30.400ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114832024-12-21T06:26:30.400ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1721, tv_nsec: 485666876 } })
114842024-12-21T06:26:30.400ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
114852024-12-21T06:26:30.401ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
114862024-12-21T06:26:30.401ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 50.882831ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
114872024-12-21T06:26:30.401ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
114882024-12-21T06:26:30.401ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
114892024-12-21T06:26:30.401ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
114902024-12-21T06:26:30.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
114912024-12-21T06:26:30.402ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
114922024-12-21T06:26:30.402ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
114932024-12-21T06:26:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
114942024-12-21T06:26:30.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
114952024-12-21T06:26:30.403ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
114962024-12-21T06:26:30.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
114972024-12-21T06:26:30.404ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
114982024-12-21T06:26:30.404ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114992024-12-21T06:26:30.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115002024-12-21T06:26:30.404ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.262996ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
115012024-12-21T06:26:30.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115022024-12-21T06:26:30.405ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115032024-12-21T06:26:30.408ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
115042024-12-21T06:26:30.408ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115052024-12-21T06:26:30.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115062024-12-21T06:26:30.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
115072024-12-21T06:26:30.409ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115082024-12-21T06:26:30.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115092024-12-21T06:26:30.409ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115102024-12-21T06:26:30.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115112024-12-21T06:26:30.409ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
115122024-12-21T06:26:30.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
115132024-12-21T06:26:30.410ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.940783ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
115142024-12-21T06:26:30.412ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.515226ms iteration = 26 status = 0
115152024-12-21T06:26:30.424ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
115162024-12-21T06:26:30.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
115172024-12-21T06:26:30.428ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
115182024-12-21T06:26:30.428ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.546246ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
115192024-12-21T06:26:30.434ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115202024-12-21T06:26:30.434ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
115212024-12-21T06:26:30.434ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
115222024-12-21T06:26:30.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
115232024-12-21T06:26:30.435ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
115242024-12-21T06:26:30.435ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115252024-12-21T06:26:30.435ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "91f8300c-0c18-4e45-88a7-e3f7f5c29672", "content-length": "26", "date": "Sat, 21 Dec 2024 06:26:30 GMT"} })
115262024-12-21T06:26:30.435ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115272024-12-21T06:26:30.438ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
115282024-12-21T06:26:30.441ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
115292024-12-21T06:26:30.441ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115302024-12-21T06:26:30.441ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "673d64e1-9845-403c-8a28-23cee0f06339", "content-length": "26", "date": "Sat, 21 Dec 2024 06:26:30 GMT"} })
115312024-12-21T06:26:30.441ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115322024-12-21T06:26:30.442ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
115332024-12-21T06:26:30.443ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.653039ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
115342024-12-21T06:26:30.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.714727ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115352024-12-21T06:26:30.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 92.334351ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
115362024-12-21T06:26:30.453ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115372024-12-21T06:26:30.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115382024-12-21T06:26:30.457ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 106.995798ms iteration = 30 status = {"physical_disks_added":0}
115392024-12-21T06:26:30.462ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115402024-12-21T06:26:30.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115412024-12-21T06:26:30.464ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115422024-12-21T06:26:30.464ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
115432024-12-21T06:26:30.464ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
115442024-12-21T06:26:30.464ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.783876ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
115452024-12-21T06:26:30.466ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
115462024-12-21T06:26:30.466ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115472024-12-21T06:26:30.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115482024-12-21T06:26:30.466ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 111.531523ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
115492024-12-21T06:26:30.467ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115502024-12-21T06:26:30.469ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
115512024-12-21T06:26:30.469ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
115522024-12-21T06:26:30.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
115532024-12-21T06:26:30.485ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
115542024-12-21T06:26:30.485ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
115552024-12-21T06:26:30.486ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bab9f8d4-e3ff-4c83-a9e7-601ac99c0b0c", "content-length": "26", "date": "Sat, 21 Dec 2024 06:26:30 GMT"} })
115562024-12-21T06:26:30.486ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
115572024-12-21T06:26:30.487ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
115582024-12-21T06:26:30.545ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 196.198841ms iteration = 26 status = {}
115592024-12-21T06:26:30.547ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
115602024-12-21T06:26:30.548ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1bc47261-5faf-440b-a99d-3ca223e6c2d3", "content-length": "2", "date": "Sat, 21 Dec 2024 06:26:29 GMT"} })
115612024-12-21T06:26:30.549ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
115622024-12-21T06:26:30.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115632024-12-21T06:26:30.551ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 202.240539ms iteration = 26 status = null
115642024-12-21T06:26:30.560ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
115652024-12-21T06:26:30.560ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115662024-12-21T06:26:30.560ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "946e033b-45b6-41bc-a9fa-963b6048e05f", "content-length": "372", "date": "Sat, 21 Dec 2024 06:26:30 GMT"} })
115672024-12-21T06:26:30.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115682024-12-21T06:26:30.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115692024-12-21T06:26:30.600ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
115702024-12-21T06:26:30.600ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "aec9d9e3-6811-4c56-9357-8ed17bc57261", "content-length": "691", "date": "Sat, 21 Dec 2024 06:26:30 GMT"} })
115712024-12-21T06:26:30.600ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
115722024-12-21T06:26:30.600ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
115732024-12-21T06:26:30.600ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
115742024-12-21T06:26:30.602ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
115752024-12-21T06:26:30.602ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
115762024-12-21T06:26:30.602ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ab4f5b34-8dd6-48ff-8a9f-211a8106f24c", "date": "Sat, 21 Dec 2024 06:26:30 GMT"} })
115772024-12-21T06:26:30.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115782024-12-21T06:26:30.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115792024-12-21T06:26:30.603ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 252.784091ms iteration = 27 status = {}
115802024-12-21T06:26:30.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115812024-12-21T06:26:30.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115822024-12-21T06:26:30.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115832024-12-21T06:26:30.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115842024-12-21T06:26:30.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c387e8e9-de63-48fa-9e24-8eeea34c9f5a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
115852024-12-21T06:26:30.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c387e8e9-de63-48fa-9e24-8eeea34c9f5a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
115862024-12-21T06:26:30.611ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
115872024-12-21T06:26:30.612ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115882024-12-21T06:26:30.612ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2624734b-0b0d-41d2-9175-3aee4949a7d6", "date": "Sat, 21 Dec 2024 06:26:30 GMT"} })
115892024-12-21T06:26:30.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c387e8e9-de63-48fa-9e24-8eeea34c9f5a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
115902024-12-21T06:26:30.614ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 258.688555ms iteration = 28 status = {}
115912024-12-21T06:26:30.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115922024-12-21T06:26:30.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115932024-12-21T06:26:30.654ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
115942024-12-21T06:26:30.654ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115952024-12-21T06:26:30.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115962024-12-21T06:26:30.663ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
115972024-12-21T06:26:30.663ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "511f1f29-2eb6-4868-a8f5-a07caa942155", "content-length": "134", "date": "Sat, 21 Dec 2024 06:26:29 GMT"} })
115982024-12-21T06:26:30.663ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
115992024-12-21T06:26:30.663ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
116002024-12-21T06:26:30.663ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
116012024-12-21T06:26:30.663ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
116022024-12-21T06:26:30.663ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116032024-12-21T06:26:30.663ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116042024-12-21T06:26:30.663ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116052024-12-21T06:26:30.663ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
116062024-12-21T06:26:30.663ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116072024-12-21T06:26:30.663ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
116082024-12-21T06:26:30.664ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
116092024-12-21T06:26:30.664ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116102024-12-21T06:26:30.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116112024-12-21T06:26:30.666ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
116122024-12-21T06:26:30.666ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "516ff5e0-7171-47b3-aa9e-af01bb2fb909", "content-length": "2", "date": "Sat, 21 Dec 2024 06:26:29 GMT"} })
116132024-12-21T06:26:30.666ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
116142024-12-21T06:26:30.666ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fb14a42-e717-46a2-b232-a0496e679432", "content-length": "52", "date": "Sat, 21 Dec 2024 06:26:29 GMT"} })
116152024-12-21T06:26:30.666ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
116162024-12-21T06:26:30.666ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
116172024-12-21T06:26:30.758ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "42e19f5e-530e-40a0-811c-76777b88923a", "date": "Sat, 21 Dec 2024 06:26:30 GMT"} })
116182024-12-21T06:26:30.758ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
116192024-12-21T06:26:30.758ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
116202024-12-21T06:26:30.758ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f1e2a46-9def-4d3e-a66c-e2734fdc04f1", "content-length": "682", "date": "Sat, 21 Dec 2024 06:26:30 GMT"} })
116212024-12-21T06:26:30.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116222024-12-21T06:26:30.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116232024-12-21T06:26:30.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116242024-12-21T06:26:30.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116252024-12-21T06:26:30.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116262024-12-21T06:26:30.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116272024-12-21T06:26:30.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116282024-12-21T06:26:30.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116292024-12-21T06:26:30.774ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 424.054621ms iteration = 26 status = {}
116302024-12-21T06:26:31.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bbd5d239-cf53-4024-96c0-4693e178d25d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116312024-12-21T06:26:31.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bbd5d239-cf53-4024-96c0-4693e178d25d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116322024-12-21T06:26:31.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bbd5d239-cf53-4024-96c0-4693e178d25d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116332024-12-21T06:26:32.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 626c46bd-529b-40d1-8432-f8e21f8d644c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116342024-12-21T06:26:32.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 626c46bd-529b-40d1-8432-f8e21f8d644c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116352024-12-21T06:26:32.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 626c46bd-529b-40d1-8432-f8e21f8d644c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116362024-12-21T06:26:33.273ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:48017
116372024-12-21T06:26:33.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48017 req_id = 06c08bd0-6180-4e13-becf-37740c10828e roles = RoleSet { roles: {} } uri = /metrics/producers
116382024-12-21T06:26:33.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48017 req_id = 06c08bd0-6180-4e13-becf-37740c10828e resource = Database result = Ok(()) uri = /metrics/producers
116392024-12-21T06:26:33.309ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 98955a77-d432-4135-98da-54d3ff354ace
116402024-12-21T06:26:33.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36028 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:48017 req_id = 06c08bd0-6180-4e13-becf-37740c10828e response_code = 201 uri = /metrics/producers
116412024-12-21T06:26:33.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dd31c429-d1e0-47e6-ad5b-34d91b9c95f3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116422024-12-21T06:26:33.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dd31c429-d1e0-47e6-ad5b-34d91b9c95f3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116432024-12-21T06:26:33.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = dd31c429-d1e0-47e6-ad5b-34d91b9c95f3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116442024-12-21T06:26:33.914ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:55419
116452024-12-21T06:26:33.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55419 req_id = f1b65501-0681-4065-bdee-bd9198e2a35a roles = RoleSet { roles: {} } uri = /metrics/producers
116462024-12-21T06:26:33.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55419 req_id = f1b65501-0681-4065-bdee-bd9198e2a35a resource = Database result = Ok(()) uri = /metrics/producers
116472024-12-21T06:26:33.950ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = d1b17d65-9e31-4f7b-88f5-d7566540099b
116482024-12-21T06:26:33.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36117 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55419 req_id = f1b65501-0681-4065-bdee-bd9198e2a35a response_code = 201 uri = /metrics/producers
116492024-12-21T06:26:33.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1232 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 1e0d818e-433a-4eed-9358-8844a34664e1 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
116502024-12-21T06:26:34.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2921ffaa-0d78-48e5-a327-d290f69947ca roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116512024-12-21T06:26:34.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2921ffaa-0d78-48e5-a327-d290f69947ca resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116522024-12-21T06:26:34.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2921ffaa-0d78-48e5-a327-d290f69947ca response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116532024-12-21T06:26:35.593ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33881
116542024-12-21T06:26:35.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33881 req_id = 5d6bf17e-d28a-499a-bbff-eb35bba155ff roles = RoleSet { roles: {} } uri = /metrics/producers
116552024-12-21T06:26:35.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33881 req_id = 5d6bf17e-d28a-499a-bbff-eb35bba155ff resource = Database result = Ok(()) uri = /metrics/producers
116562024-12-21T06:26:35.629ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 0816076d-2e0e-472b-89a8-a9ecbfd48b43
116572024-12-21T06:26:35.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35328 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33881 req_id = 5d6bf17e-d28a-499a-bbff-eb35bba155ff response_code = 201 uri = /metrics/producers
116582024-12-21T06:26:35.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 805fd623-3429-418c-a264-a55ddb8d9851 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116592024-12-21T06:26:35.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 805fd623-3429-418c-a264-a55ddb8d9851 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116602024-12-21T06:26:35.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2408 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 805fd623-3429-418c-a264-a55ddb8d9851 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116612024-12-21T06:26:36.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eb32a00b-efad-4c85-8862-dff2b1e99f4f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116622024-12-21T06:26:36.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eb32a00b-efad-4c85-8862-dff2b1e99f4f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116632024-12-21T06:26:36.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2109 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = eb32a00b-efad-4c85-8862-dff2b1e99f4f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116642024-12-21T06:26:37.788ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:44217
116652024-12-21T06:26:37.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8065ae41-0ce7-40e3-8f80-8476708341bd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116662024-12-21T06:26:37.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8065ae41-0ce7-40e3-8f80-8476708341bd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116672024-12-21T06:26:37.788ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44217 req_id = 6a73fb6d-3238-4490-b272-4a6075b51b40 roles = RoleSet { roles: {} } uri = /metrics/producers
116682024-12-21T06:26:37.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44217 req_id = 6a73fb6d-3238-4490-b272-4a6075b51b40 resource = Database result = Ok(()) uri = /metrics/producers
116692024-12-21T06:26:37.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8065ae41-0ce7-40e3-8f80-8476708341bd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116702024-12-21T06:26:37.827ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = cf7f8320-e45e-46f1-aa3b-b101ce937c63
116712024-12-21T06:26:37.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38661 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:44217 req_id = 6a73fb6d-3238-4490-b272-4a6075b51b40 response_code = 201 uri = /metrics/producers
116722024-12-21T06:26:38.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b241c28b-3cf4-424f-b3ae-d200b32a0169 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116732024-12-21T06:26:38.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b241c28b-3cf4-424f-b3ae-d200b32a0169 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116742024-12-21T06:26:38.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2657 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b241c28b-3cf4-424f-b3ae-d200b32a0169 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116752024-12-21T06:26:39.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 99d55507-7008-470e-9762-a54ef0f50901 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116762024-12-21T06:26:39.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 99d55507-7008-470e-9762-a54ef0f50901 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116772024-12-21T06:26:39.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2782 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 99d55507-7008-470e-9762-a54ef0f50901 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
116782024-12-21T06:26:40.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
116792024-12-21T06:26:40.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116802024-12-21T06:26:40.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116812024-12-21T06:26:40.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
116822024-12-21T06:26:40.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116832024-12-21T06:26:40.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116842024-12-21T06:26:40.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116852024-12-21T06:26:40.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116862024-12-21T06:26:40.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116872024-12-21T06:26:40.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116882024-12-21T06:26:40.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116892024-12-21T06:26:40.354ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.082083ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116902024-12-21T06:26:40.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116912024-12-21T06:26:40.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116922024-12-21T06:26:40.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116932024-12-21T06:26:40.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116942024-12-21T06:26:40.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
116952024-12-21T06:26:40.360ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116962024-12-21T06:26:40.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116972024-12-21T06:26:40.372ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
116982024-12-21T06:26:40.372ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.604287ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
116992024-12-21T06:26:40.592ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
117002024-12-21T06:26:40.592ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
117012024-12-21T06:26:40.622ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
117022024-12-21T06:26:40.622ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:46146
117032024-12-21T06:26:40.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46146 req_id = d3284e86-a6f2-414c-b75d-9414178e6edf roles = RoleSet { roles: {} } uri = /metrics/producers
117042024-12-21T06:26:40.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46146 req_id = d3284e86-a6f2-414c-b75d-9414178e6edf resource = Database result = Ok(()) uri = /metrics/producers
117052024-12-21T06:26:40.635ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
117062024-12-21T06:26:40.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12139 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46146 req_id = d3284e86-a6f2-414c-b75d-9414178e6edf response_code = 201 uri = /metrics/producers
117072024-12-21T06:26:40.635ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d3284e86-a6f2-414c-b75d-9414178e6edf", "content-length": "41", "date": "Sat, 21 Dec 2024 06:26:39 GMT"} })
117082024-12-21T06:26:40.636ZDEBGnexus (producer-registration-task): registered with nexus successfully
117092024-12-21T06:26:40.636ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
117102024-12-21T06:26:40.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 46a8672f-4ee4-4995-9603-bdc555d4cfd1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117112024-12-21T06:26:40.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 46a8672f-4ee4-4995-9603-bdc555d4cfd1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117122024-12-21T06:26:40.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 46a8672f-4ee4-4995-9603-bdc555d4cfd1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117132024-12-21T06:26:41.486ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = c678e50e-a2c2-489d-9565-adf5432914fe roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
117142024-12-21T06:26:41.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = c678e50e-a2c2-489d-9565-adf5432914fe resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
117152024-12-21T06:26:41.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = c678e50e-a2c2-489d-9565-adf5432914fe response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
117162024-12-21T06:26:41.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff22f0b1-59ac-4ced-9778-27c695c1555a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117172024-12-21T06:26:41.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff22f0b1-59ac-4ced-9778-27c695c1555a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117182024-12-21T06:26:41.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2666 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ff22f0b1-59ac-4ced-9778-27c695c1555a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117192024-12-21T06:26:42.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 59892900-4fed-4c6b-849a-868f6c532217 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117202024-12-21T06:26:42.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 59892900-4fed-4c6b-849a-868f6c532217 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117212024-12-21T06:26:42.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 59892900-4fed-4c6b-849a-868f6c532217 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117222024-12-21T06:26:43.340ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:62978
117232024-12-21T06:26:43.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62978 req_id = 3ab32a42-60bf-4ece-a68f-43d19eab8d78 roles = RoleSet { roles: {} } uri = /metrics/producers
117242024-12-21T06:26:43.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62978 req_id = 3ab32a42-60bf-4ece-a68f-43d19eab8d78 resource = Database result = Ok(()) uri = /metrics/producers
117252024-12-21T06:26:43.351ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 49f39df6-9f0d-49d5-a626-07ee31ec1ff4
117262024-12-21T06:26:43.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10576 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62978 req_id = 3ab32a42-60bf-4ece-a68f-43d19eab8d78 response_code = 201 uri = /metrics/producers
117272024-12-21T06:26:43.726ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:34674
117282024-12-21T06:26:43.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34674 req_id = a9a1f222-d0e4-4762-bd5e-c6e0ee5de3f7 roles = RoleSet { roles: {} } uri = /metrics/producers
117292024-12-21T06:26:43.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34674 req_id = a9a1f222-d0e4-4762-bd5e-c6e0ee5de3f7 resource = Database result = Ok(()) uri = /metrics/producers
117302024-12-21T06:26:43.733ZINFOnexus: assigned collector to new producer collector_id = 40f81c4f-7bfa-4222-940b-53f4f10b067d file = nexus/src/app/oximeter.rs:76 producer_id = 47090b0b-c8ad-4dca-92e5-38fed29ad6d5
117312024-12-21T06:26:43.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7351 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34674 req_id = a9a1f222-d0e4-4762-bd5e-c6e0ee5de3f7 response_code = 201 uri = /metrics/producers
117322024-12-21T06:26:43.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ba113856-48ed-4fb1-88f2-1b68186e30d7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117332024-12-21T06:26:43.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ba113856-48ed-4fb1-88f2-1b68186e30d7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117342024-12-21T06:26:43.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ba113856-48ed-4fb1-88f2-1b68186e30d7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117352024-12-21T06:26:43.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1366 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 1a1f970f-36db-4624-afa0-8f4d1d361ab5 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
117362024-12-21T06:26:44.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cd0c202f-196f-4154-b466-2f2f37840fde roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117372024-12-21T06:26:44.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cd0c202f-196f-4154-b466-2f2f37840fde resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117382024-12-21T06:26:44.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cd0c202f-196f-4154-b466-2f2f37840fde response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117392024-12-21T06:26:45.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f0e4c1a8-9ab0-4ce3-8caf-708e0ac869f2 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117402024-12-21T06:26:45.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f0e4c1a8-9ab0-4ce3-8caf-708e0ac869f2 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117412024-12-21T06:26:45.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f0e4c1a8-9ab0-4ce3-8caf-708e0ac869f2 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117422024-12-21T06:26:46.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4f0e5f7f-e623-4058-bf38-b59044157afe roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117432024-12-21T06:26:46.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4f0e5f7f-e623-4058-bf38-b59044157afe resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117442024-12-21T06:26:46.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4f0e5f7f-e623-4058-bf38-b59044157afe response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117452024-12-21T06:26:48.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f52c3178-658f-4bfb-9404-05014882bfec roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117462024-12-21T06:26:48.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f52c3178-658f-4bfb-9404-05014882bfec resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117472024-12-21T06:26:48.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f52c3178-658f-4bfb-9404-05014882bfec response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117482024-12-21T06:26:49.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0b5ef1cb-1590-4f0a-95f4-c8a084117647 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117492024-12-21T06:26:49.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0b5ef1cb-1590-4f0a-95f4-c8a084117647 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117502024-12-21T06:26:49.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0b5ef1cb-1590-4f0a-95f4-c8a084117647 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117512024-12-21T06:26:50.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 69820843-3451-49e6-a200-3661947bb32d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117522024-12-21T06:26:50.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 69820843-3451-49e6-a200-3661947bb32d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117532024-12-21T06:26:50.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2503 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 69820843-3451-49e6-a200-3661947bb32d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117542024-12-21T06:26:50.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
117552024-12-21T06:26:50.350ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117562024-12-21T06:26:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117572024-12-21T06:26:50.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
117582024-12-21T06:26:50.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117592024-12-21T06:26:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117602024-12-21T06:26:50.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117612024-12-21T06:26:50.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117622024-12-21T06:26:50.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117632024-12-21T06:26:50.355ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.610388ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117642024-12-21T06:26:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117652024-12-21T06:26:50.355ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117662024-12-21T06:26:50.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117672024-12-21T06:26:50.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117682024-12-21T06:26:50.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117692024-12-21T06:26:50.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117702024-12-21T06:26:50.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
117712024-12-21T06:26:50.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117722024-12-21T06:26:50.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117732024-12-21T06:26:50.370ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
117742024-12-21T06:26:50.370ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.604011ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
117752024-12-21T06:26:51.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4054d635-b2c3-4be8-b13d-2d48d8df7e7a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117762024-12-21T06:26:51.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4054d635-b2c3-4be8-b13d-2d48d8df7e7a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117772024-12-21T06:26:51.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4054d635-b2c3-4be8-b13d-2d48d8df7e7a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117782024-12-21T06:26:52.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ed33a090-9fc8-4650-b555-5306838361df roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117792024-12-21T06:26:52.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ed33a090-9fc8-4650-b555-5306838361df resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117802024-12-21T06:26:52.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ed33a090-9fc8-4650-b555-5306838361df response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117812024-12-21T06:26:53.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6277d457-c4ce-41bd-b370-06752fbd5b17 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117822024-12-21T06:26:53.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6277d457-c4ce-41bd-b370-06752fbd5b17 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117832024-12-21T06:26:53.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2498 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6277d457-c4ce-41bd-b370-06752fbd5b17 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117842024-12-21T06:26:53.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1378 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 10be0d61-5f2b-48d0-8b88-3e6f5fe55be7 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
117852024-12-21T06:26:54.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f71eaa1a-bc08-4498-81b8-1f42ad1c97bc roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117862024-12-21T06:26:54.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f71eaa1a-bc08-4498-81b8-1f42ad1c97bc resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117872024-12-21T06:26:54.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f71eaa1a-bc08-4498-81b8-1f42ad1c97bc response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117882024-12-21T06:26:55.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 27417fb7-9ff0-4a49-a3a0-4c754836a6e7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117892024-12-21T06:26:55.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 27417fb7-9ff0-4a49-a3a0-4c754836a6e7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117902024-12-21T06:26:55.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1674 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 27417fb7-9ff0-4a49-a3a0-4c754836a6e7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117912024-12-21T06:26:56.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 32d7cf46-76b9-4dd1-a78d-b671a1b49ff1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117922024-12-21T06:26:56.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 32d7cf46-76b9-4dd1-a78d-b671a1b49ff1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117932024-12-21T06:26:56.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2370 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 32d7cf46-76b9-4dd1-a78d-b671a1b49ff1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117942024-12-21T06:26:57.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5c81d121-b0af-4c74-814e-2d5c064cecb7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117952024-12-21T06:26:57.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5c81d121-b0af-4c74-814e-2d5c064cecb7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117962024-12-21T06:26:57.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5c81d121-b0af-4c74-814e-2d5c064cecb7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117972024-12-21T06:26:58.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c8a22412-0c95-47dc-a321-c42ba2316019 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117982024-12-21T06:26:58.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c8a22412-0c95-47dc-a321-c42ba2316019 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
117992024-12-21T06:26:58.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c8a22412-0c95-47dc-a321-c42ba2316019 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
118002024-12-21T06:26:59.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e1fdcdff-efa4-4340-9aa1-f2aa9fa796ef roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
118012024-12-21T06:26:59.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e1fdcdff-efa4-4340-9aa1-f2aa9fa796ef resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
118022024-12-21T06:26:59.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2658 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e1fdcdff-efa4-4340-9aa1-f2aa9fa796ef response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
118032024-12-21T06:27:00.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6e9303d7-da69-41fa-bbe7-6ff9e85c2114 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
118042024-12-21T06:27:00.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6e9303d7-da69-41fa-bbe7-6ff9e85c2114 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
118052024-12-21T06:27:00.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6e9303d7-da69-41fa-bbe7-6ff9e85c2114 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
118062024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
118072024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
118082024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
118092024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
118102024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
118112024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118122024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118132024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
118142024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
118152024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
118162024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
118172024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118182024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
118192024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
118202024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
118212024-12-21T06:27:00.349ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 06:17:00.349236668 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
118222024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
118232024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
118242024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
118252024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
118262024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118272024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
118282024-12-21T06:27:00.349ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 7c419228-2431-4394-af83-ea0457364b70
118292024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
118302024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.42\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"7c419228-2431-4394-af83-ea0457364b70"}
118312024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118322024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
118332024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
118342024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118352024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
118362024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118372024-12-21T06:27:00.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
118382024-12-21T06:27:00.349ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1751, tv_nsec: 435277339 } })
118392024-12-21T06:27:00.349ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("068965c6-3480-4953-b57e-dd969abb2a21.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("45c0a855-5592-491c-b7b3-470902319db2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1751, tv_nsec: 435389142 } })
118402024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
118412024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
118422024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
118432024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118442024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118452024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
118462024-12-21T06:27:00.350ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
118472024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
118482024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
118492024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118502024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
118512024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118522024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
118532024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118542024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
118552024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
118562024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
118572024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
118582024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
118592024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
118602024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
118612024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118622024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
118632024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.141662ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
118642024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118652024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118662024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118672024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
118682024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118692024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
118702024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118712024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
118722024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.287316ms iteration = 15 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
118732024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
118742024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118752024-12-21T06:27:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
118762024-12-21T06:27:00.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118772024-12-21T06:27:00.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
118782024-12-21T06:27:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
118792024-12-21T06:27:00.352ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1751, tv_nsec: 437501951 } })
118802024-12-21T06:27:00.352ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
118812024-12-21T06:27:00.352ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.462386ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
118822024-12-21T06:27:00.353ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118832024-12-21T06:27:00.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1751, tv_nsec: 438789296 } })
118842024-12-21T06:27:00.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
118852024-12-21T06:27:00.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118862024-12-21T06:27:00.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118872024-12-21T06:27:00.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118882024-12-21T06:27:00.354ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
118892024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
118902024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
118912024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
118922024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
118932024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
118942024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
118952024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118962024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
118972024-12-21T06:27:00.355ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
118982024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118992024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
119002024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
119012024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
119022024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
119032024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
119042024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119052024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
119062024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
119072024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
119082024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
119092024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119102024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119112024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
119122024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
119132024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
119142024-12-21T06:27:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
119152024-12-21T06:27:00.356ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119162024-12-21T06:27:00.356ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 06:17:00.349236668 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
119172024-12-21T06:27:00.356ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.700953ms iteration = 14 status = {"expiration":"2024-12-21T06:17:00.349236668Z","pruned":[]}
119182024-12-21T06:27:00.357ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119192024-12-21T06:27:00.358ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119202024-12-21T06:27:00.358ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119212024-12-21T06:27:00.358ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
119222024-12-21T06:27:00.358ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119232024-12-21T06:27:00.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119242024-12-21T06:27:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
119252024-12-21T06:27:00.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119262024-12-21T06:27:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119272024-12-21T06:27:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
119282024-12-21T06:27:00.360ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119292024-12-21T06:27:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119302024-12-21T06:27:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119312024-12-21T06:27:00.360ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119322024-12-21T06:27:00.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119332024-12-21T06:27:00.362ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119342024-12-21T06:27:00.363ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119352024-12-21T06:27:00.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
119362024-12-21T06:27:00.364ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
119372024-12-21T06:27:00.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
119382024-12-21T06:27:00.365ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119392024-12-21T06:27:00.366ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
119402024-12-21T06:27:00.366ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
119412024-12-21T06:27:00.366ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119422024-12-21T06:27:00.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
119432024-12-21T06:27:00.366ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119442024-12-21T06:27:00.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119452024-12-21T06:27:00.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119462024-12-21T06:27:00.367ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119472024-12-21T06:27:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
119482024-12-21T06:27:00.368ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
119492024-12-21T06:27:00.369ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
119502024-12-21T06:27:00.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119512024-12-21T06:27:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119522024-12-21T06:27:00.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
119532024-12-21T06:27:00.377ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1751, tv_nsec: 462905196 } })
119542024-12-21T06:27:00.377ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
119552024-12-21T06:27:00.380ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.127607ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
119562024-12-21T06:27:00.380ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119572024-12-21T06:27:00.384ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
119582024-12-21T06:27:00.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119592024-12-21T06:27:00.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119602024-12-21T06:27:00.385ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119612024-12-21T06:27:00.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119622024-12-21T06:27:00.386ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119632024-12-21T06:27:00.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119642024-12-21T06:27:00.388ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119652024-12-21T06:27:00.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
119662024-12-21T06:27:00.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119672024-12-21T06:27:00.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119682024-12-21T06:27:00.393ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119692024-12-21T06:27:00.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
119702024-12-21T06:27:00.396ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119712024-12-21T06:27:00.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119722024-12-21T06:27:00.408ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
119732024-12-21T06:27:00.408ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.805429ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
119742024-12-21T06:27:00.410ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
119752024-12-21T06:27:00.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
119762024-12-21T06:27:00.413ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 63.087129ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
119772024-12-21T06:27:00.416ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119782024-12-21T06:27:00.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119792024-12-21T06:27:00.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.556251ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
119802024-12-21T06:27:00.418ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 68.724506ms iteration = 31 status = {"physical_disks_added":0}
119812024-12-21T06:27:00.422ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.781112ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
119822024-12-21T06:27:00.423ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119832024-12-21T06:27:00.423ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119842024-12-21T06:27:00.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119852024-12-21T06:27:00.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119862024-12-21T06:27:00.424ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
119872024-12-21T06:27:00.424ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119882024-12-21T06:27:00.424ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
119892024-12-21T06:27:00.424ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
119902024-12-21T06:27:00.424ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
119912024-12-21T06:27:00.424ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119922024-12-21T06:27:00.424ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
119932024-12-21T06:27:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119942024-12-21T06:27:00.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
119952024-12-21T06:27:00.425ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119962024-12-21T06:27:00.425ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119972024-12-21T06:27:00.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119982024-12-21T06:27:00.427ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
119992024-12-21T06:27:00.427ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
120002024-12-21T06:27:00.427ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 72.001687ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
120012024-12-21T06:27:00.427ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.144871ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
120022024-12-21T06:27:00.428ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
120032024-12-21T06:27:00.428ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120042024-12-21T06:27:00.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120052024-12-21T06:27:00.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120062024-12-21T06:27:00.433ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
120072024-12-21T06:27:00.433ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
120082024-12-21T06:27:00.433ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 83.591239ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
120092024-12-21T06:27:00.434ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
120102024-12-21T06:27:00.434ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120112024-12-21T06:27:00.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120122024-12-21T06:27:00.435ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
120132024-12-21T06:27:00.435ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
120142024-12-21T06:27:00.436ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.882502ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
120152024-12-21T06:27:00.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
120162024-12-21T06:27:00.436ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
120172024-12-21T06:27:00.436ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
120182024-12-21T06:27:00.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120192024-12-21T06:27:00.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120202024-12-21T06:27:00.437ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 82.133678ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
120212024-12-21T06:27:00.437ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
120222024-12-21T06:27:00.437ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
120232024-12-21T06:27:00.437ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
120242024-12-21T06:27:00.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
120252024-12-21T06:27:00.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120262024-12-21T06:27:00.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120272024-12-21T06:27:00.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120282024-12-21T06:27:00.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
120292024-12-21T06:27:00.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120302024-12-21T06:27:00.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120312024-12-21T06:27:00.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
120322024-12-21T06:27:00.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
120332024-12-21T06:27:00.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120342024-12-21T06:27:00.444ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
120352024-12-21T06:27:00.444ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
120362024-12-21T06:27:00.444ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 06:14:07.931887 UTC dns_group = internal generation = 1
120372024-12-21T06:27:00.444ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 95.729255ms iteration = 15 status = {"generation":1}
120382024-12-21T06:27:00.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
120392024-12-21T06:27:00.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
120402024-12-21T06:27:00.463ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120412024-12-21T06:27:00.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120422024-12-21T06:27:00.466ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120432024-12-21T06:27:00.467ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120442024-12-21T06:27:00.468ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
120452024-12-21T06:27:00.468ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120462024-12-21T06:27:00.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120472024-12-21T06:27:00.473ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
120482024-12-21T06:27:00.473ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 0 version = 2
120492024-12-21T06:27:00.473ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
120502024-12-21T06:27:00.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120512024-12-21T06:27:00.474ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
120522024-12-21T06:27:00.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
120532024-12-21T06:27:00.474ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120542024-12-21T06:27:00.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
120552024-12-21T06:27:00.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120562024-12-21T06:27:00.480ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120572024-12-21T06:27:00.480ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 125.716187ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
120582024-12-21T06:27:00.481ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 131.279071ms iteration = 27 status = 0
120592024-12-21T06:27:00.482ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120602024-12-21T06:27:00.482ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
120612024-12-21T06:27:00.482ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 132.267598ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
120622024-12-21T06:27:00.482ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
120632024-12-21T06:27:00.482ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
120642024-12-21T06:27:00.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120652024-12-21T06:27:00.495ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120662024-12-21T06:27:00.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120672024-12-21T06:27:00.524ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T06:13:58.796551Z, time_modified: 2024-12-21T06:13:58.796551Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }) }
120682024-12-21T06:27:00.524ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 174.924421ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]}},"default_endpoint":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
120692024-12-21T06:27:00.527ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
120702024-12-21T06:27:00.527ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120712024-12-21T06:27:00.528ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8db1230b-1209-4ccf-82a3-dcf17b5cf522", "content-length": "26", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} })
120722024-12-21T06:27:00.528ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120732024-12-21T06:27:00.530ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
120742024-12-21T06:27:00.532ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
120752024-12-21T06:27:00.532ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120762024-12-21T06:27:00.532ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cfdb662-26ae-473b-a419-4fb51ec4781c", "content-length": "26", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} })
120772024-12-21T06:27:00.532ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120782024-12-21T06:27:00.534ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
120792024-12-21T06:27:00.538ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
120802024-12-21T06:27:00.538ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 188.428856ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
120812024-12-21T06:27:00.544ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
120822024-12-21T06:27:00.544ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120832024-12-21T06:27:00.544ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2886f1f0-81b6-4f43-ba76-c3f4e2e7e5cc", "content-length": "26", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} })
120842024-12-21T06:27:00.544ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120852024-12-21T06:27:00.546ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
120862024-12-21T06:27:00.608ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
120872024-12-21T06:27:00.709ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
120882024-12-21T06:27:00.755ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
120892024-12-21T06:27:00.756ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "89fcfd35-9444-429e-b756-bf889824047c", "content-length": "2", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} })
120902024-12-21T06:27:00.757ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
120912024-12-21T06:27:00.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
120922024-12-21T06:27:00.818ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
120932024-12-21T06:27:00.818ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
120942024-12-21T06:27:00.818ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "798f2e5f-e132-4152-845a-6b3913cf082a", "content-length": "372", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} })
120952024-12-21T06:27:00.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120962024-12-21T06:27:00.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120972024-12-21T06:27:00.820ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 1 version = 2
120982024-12-21T06:27:00.820ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
120992024-12-21T06:27:00.820ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 06:14:08.776888 UTC dns_group = external generation = 2
121002024-12-21T06:27:00.820ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 470.833108ms iteration = 15 status = {"generation":2}
121012024-12-21T06:27:00.821ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 472.045313ms iteration = 27 status = null
121022024-12-21T06:27:00.833ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 484.312663ms iteration = 27 status = {}
121032024-12-21T06:27:00.859ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
121042024-12-21T06:27:00.859ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
121052024-12-21T06:27:00.860ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "516d849c-9a0b-4b94-bb95-49421b208227", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} })
121062024-12-21T06:27:00.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121072024-12-21T06:27:00.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121082024-12-21T06:27:00.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121092024-12-21T06:27:00.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121102024-12-21T06:27:00.865ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121112024-12-21T06:27:00.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121122024-12-21T06:27:00.868ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
121132024-12-21T06:27:00.868ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
121142024-12-21T06:27:00.869ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f551a7c9-dace-461d-9433-b650d5d9afaf", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} })
121152024-12-21T06:27:00.871ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 516.219228ms iteration = 29 status = {}
121162024-12-21T06:27:00.886ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
121172024-12-21T06:27:00.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121182024-12-21T06:27:00.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
121192024-12-21T06:27:00.932ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121202024-12-21T06:27:00.934ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
121212024-12-21T06:27:00.934ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121222024-12-21T06:27:00.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
121232024-12-21T06:27:00.936ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121242024-12-21T06:27:00.937ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
121252024-12-21T06:27:00.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121262024-12-21T06:27:00.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
121272024-12-21T06:27:00.954ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
121282024-12-21T06:27:00.954ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0fc4ed83-5e44-4adb-aa30-730c327668ba", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
121292024-12-21T06:27:00.954ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
121302024-12-21T06:27:00.956ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "167e43ab-6a4a-4033-8004-e03c5f7e659c", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
121312024-12-21T06:27:00.956ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
121322024-12-21T06:27:00.957ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
121332024-12-21T06:27:00.957ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 608.590979ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
121342024-12-21T06:27:00.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121352024-12-21T06:27:00.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121362024-12-21T06:27:00.976ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
121372024-12-21T06:27:00.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121382024-12-21T06:27:00.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121392024-12-21T06:27:00.984ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
121402024-12-21T06:27:00.985ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0132eb0c-1ac8-417c-aa4f-d5992d9eda27", "content-length": "134", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} })
121412024-12-21T06:27:00.985ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
121422024-12-21T06:27:00.985ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
121432024-12-21T06:27:00.985ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
121442024-12-21T06:27:00.985ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
121452024-12-21T06:27:00.985ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
121462024-12-21T06:27:00.985ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121472024-12-21T06:27:00.985ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121482024-12-21T06:27:00.985ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121492024-12-21T06:27:00.985ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
121502024-12-21T06:27:00.985ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121512024-12-21T06:27:00.985ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
121522024-12-21T06:27:00.985ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "741c83a3-9257-4cee-9310-990a066206ef", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
121532024-12-21T06:27:00.985ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
121542024-12-21T06:27:00.985ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
121552024-12-21T06:27:00.985ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121562024-12-21T06:27:00.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121572024-12-21T06:27:00.987ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e121a661-8e09-4244-8ae4-e4aefee491d2", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
121582024-12-21T06:27:00.987ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
121592024-12-21T06:27:00.987ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
121602024-12-21T06:27:00.987ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4738fe53-f3c5-4c20-808c-3d62c7fff377", "content-length": "2", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} })
121612024-12-21T06:27:00.987ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
121622024-12-21T06:27:00.987ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bee326f3-3389-4cd7-9fcc-ce6c91733ac5", "content-length": "52", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} })
121632024-12-21T06:27:00.987ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
121642024-12-21T06:27:00.987ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
121652024-12-21T06:27:00.989ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "407f7951-ad50-4f16-ab6d-7a6d3e6c4890", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
121662024-12-21T06:27:00.989ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
121672024-12-21T06:27:00.991ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
121682024-12-21T06:27:00.991ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 641.78565ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
121692024-12-21T06:27:01.020ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
121702024-12-21T06:27:01.085ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b3b3f615-6cc0-403c-8db2-200bcba81de5", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} })
121712024-12-21T06:27:01.085ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
121722024-12-21T06:27:01.085ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
121732024-12-21T06:27:01.085ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "199ae66a-8aef-4fe5-8c96-d148ffdab96c", "content-length": "682", "date": "Sat, 21 Dec 2024 06:27:01 GMT"} })
121742024-12-21T06:27:01.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121752024-12-21T06:27:01.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121762024-12-21T06:27:01.086ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "593aa556-70ee-4d8f-8ffa-a8ed6fdc18f4", "content-length": "691", "date": "Sat, 21 Dec 2024 06:27:00 GMT"} })
121772024-12-21T06:27:01.086ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
121782024-12-21T06:27:01.086ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
121792024-12-21T06:27:01.086ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
121802024-12-21T06:27:01.087ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 737.675759ms iteration = 28 status = {}
121812024-12-21T06:27:01.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121822024-12-21T06:27:01.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121832024-12-21T06:27:01.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121842024-12-21T06:27:01.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121852024-12-21T06:27:01.099ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121862024-12-21T06:27:01.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121872024-12-21T06:27:01.107ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 757.491689ms iteration = 27 status = {}
121882024-12-21T06:27:01.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9e7ec725-2bdf-4d79-9b17-b7285de3be77 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
121892024-12-21T06:27:01.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9e7ec725-2bdf-4d79-9b17-b7285de3be77 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
121902024-12-21T06:27:01.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2010 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9e7ec725-2bdf-4d79-9b17-b7285de3be77 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
121912024-12-21T06:27:02.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c123670d-eb01-42ff-be65-c5c64c12aa4c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
121922024-12-21T06:27:02.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c123670d-eb01-42ff-be65-c5c64c12aa4c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
121932024-12-21T06:27:02.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2425 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c123670d-eb01-42ff-be65-c5c64c12aa4c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
121942024-12-21T06:27:03.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 11846f5a-e415-4c4a-820d-a50559385894 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
121952024-12-21T06:27:03.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 11846f5a-e415-4c4a-820d-a50559385894 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
121962024-12-21T06:27:03.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2757 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 11846f5a-e415-4c4a-820d-a50559385894 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
121972024-12-21T06:27:03.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1410 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 58813e8f-ab63-4278-be0a-a4cae9bb1288 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
121982024-12-21T06:27:04.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf0958cb-f5c7-4ab5-97e1-daca8b67b00f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
121992024-12-21T06:27:04.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf0958cb-f5c7-4ab5-97e1-daca8b67b00f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122002024-12-21T06:27:04.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2633 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cf0958cb-f5c7-4ab5-97e1-daca8b67b00f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122012024-12-21T06:27:05.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 551f3c45-0bd4-4e17-95bb-4a4b2c5457c1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122022024-12-21T06:27:05.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 551f3c45-0bd4-4e17-95bb-4a4b2c5457c1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122032024-12-21T06:27:05.371ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 551f3c45-0bd4-4e17-95bb-4a4b2c5457c1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122042024-12-21T06:27:06.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4235004c-3343-40a9-b025-eab37a578ac4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122052024-12-21T06:27:06.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4235004c-3343-40a9-b025-eab37a578ac4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122062024-12-21T06:27:06.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4235004c-3343-40a9-b025-eab37a578ac4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122072024-12-21T06:27:07.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2e60c1f1-7804-4cdc-8a9c-86de77c7d22a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122082024-12-21T06:27:07.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2e60c1f1-7804-4cdc-8a9c-86de77c7d22a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122092024-12-21T06:27:07.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2453 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2e60c1f1-7804-4cdc-8a9c-86de77c7d22a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122102024-12-21T06:27:08.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = aee666a0-c754-4371-94b9-e9839cc4864d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122112024-12-21T06:27:08.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = aee666a0-c754-4371-94b9-e9839cc4864d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122122024-12-21T06:27:08.438ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4818 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = aee666a0-c754-4371-94b9-e9839cc4864d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122132024-12-21T06:27:09.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95297506-8c82-438b-9bbe-d6f2320638d2 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122142024-12-21T06:27:09.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95297506-8c82-438b-9bbe-d6f2320638d2 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122152024-12-21T06:27:09.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2166 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95297506-8c82-438b-9bbe-d6f2320638d2 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122162024-12-21T06:27:10.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
122172024-12-21T06:27:10.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122182024-12-21T06:27:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122192024-12-21T06:27:10.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
122202024-12-21T06:27:10.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122212024-12-21T06:27:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122222024-12-21T06:27:10.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122232024-12-21T06:27:10.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122242024-12-21T06:27:10.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122252024-12-21T06:27:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122262024-12-21T06:27:10.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122272024-12-21T06:27:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122282024-12-21T06:27:10.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122292024-12-21T06:27:10.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122302024-12-21T06:27:10.380ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.221608ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
122312024-12-21T06:27:10.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122322024-12-21T06:27:10.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
122332024-12-21T06:27:10.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122342024-12-21T06:27:10.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122352024-12-21T06:27:10.400ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
122362024-12-21T06:27:10.400ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.455007ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
122372024-12-21T06:27:10.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6a93a5b3-78a5-4962-8f5b-071d38970c06 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122382024-12-21T06:27:10.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6a93a5b3-78a5-4962-8f5b-071d38970c06 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122392024-12-21T06:27:10.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1719 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 6a93a5b3-78a5-4962-8f5b-071d38970c06 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122402024-12-21T06:27:11.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bf9af92f-ad9e-4c5e-a6e0-fab72578ae3d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122412024-12-21T06:27:11.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bf9af92f-ad9e-4c5e-a6e0-fab72578ae3d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122422024-12-21T06:27:11.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = bf9af92f-ad9e-4c5e-a6e0-fab72578ae3d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122432024-12-21T06:27:11.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = c5b47e17-ff86-4ab9-a528-a3234340144a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
122442024-12-21T06:27:11.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = c5b47e17-ff86-4ab9-a528-a3234340144a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
122452024-12-21T06:27:11.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = c5b47e17-ff86-4ab9-a528-a3234340144a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
122462024-12-21T06:27:12.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 464ac917-ffc9-45c9-98c0-ba431ca08666 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122472024-12-21T06:27:12.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 464ac917-ffc9-45c9-98c0-ba431ca08666 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122482024-12-21T06:27:12.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 464ac917-ffc9-45c9-98c0-ba431ca08666 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122492024-12-21T06:27:13.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9bb528ef-b8de-4255-ac8b-3b45a0585d1a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122502024-12-21T06:27:13.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9bb528ef-b8de-4255-ac8b-3b45a0585d1a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122512024-12-21T06:27:13.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9bb528ef-b8de-4255-ac8b-3b45a0585d1a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122522024-12-21T06:27:13.941ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:36058
122532024-12-21T06:27:13.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = 6ff64824-d023-47d5-a5ca-7569f6103eaa roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
122542024-12-21T06:27:13.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = 6ff64824-d023-47d5-a5ca-7569f6103eaa resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
122552024-12-21T06:27:13.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = 6ff64824-d023-47d5-a5ca-7569f6103eaa response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
122562024-12-21T06:27:13.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = c1848864-ddb4-4d0a-b7ef-51f16f61922b roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
122572024-12-21T06:27:13.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = c1848864-ddb4-4d0a-b7ef-51f16f61922b resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
122582024-12-21T06:27:13.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = c1848864-ddb4-4d0a-b7ef-51f16f61922b response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
122592024-12-21T06:27:13.967ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1212 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 440b2274-86a5-4d19-9f0f-416102f9cb01 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
122602024-12-21T06:27:14.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 87de0ed7-60c3-4185-b001-12abf4ec8c35 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122612024-12-21T06:27:14.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 87de0ed7-60c3-4185-b001-12abf4ec8c35 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122622024-12-21T06:27:14.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 87de0ed7-60c3-4185-b001-12abf4ec8c35 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122632024-12-21T06:27:15.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2fbf52f9-5983-4d37-8e8a-d862b225b81c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122642024-12-21T06:27:15.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2fbf52f9-5983-4d37-8e8a-d862b225b81c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122652024-12-21T06:27:15.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2fbf52f9-5983-4d37-8e8a-d862b225b81c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122662024-12-21T06:27:16.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3e6bd230-8fca-452a-860f-8ce2ceb8926b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122672024-12-21T06:27:16.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3e6bd230-8fca-452a-860f-8ce2ceb8926b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122682024-12-21T06:27:16.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3e6bd230-8fca-452a-860f-8ce2ceb8926b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122692024-12-21T06:27:17.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = da32755e-6a9c-4c05-a7c3-38b7ce17cb44 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122702024-12-21T06:27:17.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = da32755e-6a9c-4c05-a7c3-38b7ce17cb44 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122712024-12-21T06:27:17.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = da32755e-6a9c-4c05-a7c3-38b7ce17cb44 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122722024-12-21T06:27:18.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9fe5d5a0-704c-4035-b8a7-d8063fe92dab roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122732024-12-21T06:27:18.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9fe5d5a0-704c-4035-b8a7-d8063fe92dab resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122742024-12-21T06:27:18.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9fe5d5a0-704c-4035-b8a7-d8063fe92dab response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122752024-12-21T06:27:19.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d5b56538-1a31-460b-973c-6ae95430efca roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122762024-12-21T06:27:19.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d5b56538-1a31-460b-973c-6ae95430efca resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122772024-12-21T06:27:19.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2574 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d5b56538-1a31-460b-973c-6ae95430efca response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
122782024-12-21T06:27:20.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
122792024-12-21T06:27:20.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122802024-12-21T06:27:20.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122812024-12-21T06:27:20.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
122822024-12-21T06:27:20.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122832024-12-21T06:27:20.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122842024-12-21T06:27:20.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122852024-12-21T06:27:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122862024-12-21T06:27:20.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122872024-12-21T06:27:20.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122882024-12-21T06:27:20.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122892024-12-21T06:27:20.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122902024-12-21T06:27:20.357ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122912024-12-21T06:27:20.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
122922024-12-21T06:27:20.359ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122932024-12-21T06:27:20.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122942024-12-21T06:27:20.371ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
122952024-12-21T06:27:20.371ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.249488ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
122962024-12-21T06:27:20.379ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122972024-12-21T06:27:20.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122982024-12-21T06:27:20.408ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.030339ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
122992024-12-21T06:27:20.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f08c034c-ba6d-4883-afca-b2ee2a1228d0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123002024-12-21T06:27:20.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f08c034c-ba6d-4883-afca-b2ee2a1228d0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123012024-12-21T06:27:20.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f08c034c-ba6d-4883-afca-b2ee2a1228d0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123022024-12-21T06:27:21.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e408743d-116c-4590-ae7c-5633e785dbc8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123032024-12-21T06:27:21.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e408743d-116c-4590-ae7c-5633e785dbc8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123042024-12-21T06:27:21.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e408743d-116c-4590-ae7c-5633e785dbc8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123052024-12-21T06:27:22.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 512e2e53-cfad-444c-9667-7d0f50154e7d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123062024-12-21T06:27:22.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 512e2e53-cfad-444c-9667-7d0f50154e7d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123072024-12-21T06:27:22.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2521 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 512e2e53-cfad-444c-9667-7d0f50154e7d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123082024-12-21T06:27:23.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ce1929a-e77a-4e52-ac6f-2d7a7fb6f0dd roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123092024-12-21T06:27:23.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ce1929a-e77a-4e52-ac6f-2d7a7fb6f0dd resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123102024-12-21T06:27:23.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8ce1929a-e77a-4e52-ac6f-2d7a7fb6f0dd response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123112024-12-21T06:27:23.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1388 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 99006c5e-79ec-43bf-9bc3-5a2dd7b5dec0 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
123122024-12-21T06:27:24.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 116c5f4e-4b47-40be-87f5-067d20279d58 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123132024-12-21T06:27:24.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 116c5f4e-4b47-40be-87f5-067d20279d58 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123142024-12-21T06:27:24.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2794 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 116c5f4e-4b47-40be-87f5-067d20279d58 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123152024-12-21T06:27:25.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8a163b84-141b-4b78-9987-af59d87d6c2f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123162024-12-21T06:27:25.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8a163b84-141b-4b78-9987-af59d87d6c2f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123172024-12-21T06:27:25.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 8a163b84-141b-4b78-9987-af59d87d6c2f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123182024-12-21T06:27:26.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1250fc62-1dcc-4ba9-9bdd-199607ec4f2c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123192024-12-21T06:27:26.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1250fc62-1dcc-4ba9-9bdd-199607ec4f2c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123202024-12-21T06:27:26.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2283 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1250fc62-1dcc-4ba9-9bdd-199607ec4f2c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123212024-12-21T06:27:27.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9135219c-02c5-46cc-8745-2bcef63d07af roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123222024-12-21T06:27:27.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9135219c-02c5-46cc-8745-2bcef63d07af resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123232024-12-21T06:27:27.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9135219c-02c5-46cc-8745-2bcef63d07af response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123242024-12-21T06:27:28.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1b0798cf-616f-4c28-86e0-85f00a843da3 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123252024-12-21T06:27:28.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1b0798cf-616f-4c28-86e0-85f00a843da3 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123262024-12-21T06:27:28.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1b0798cf-616f-4c28-86e0-85f00a843da3 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123272024-12-21T06:27:29.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9cda7621-2713-4c5e-a53f-c1104c94945c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123282024-12-21T06:27:29.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9cda7621-2713-4c5e-a53f-c1104c94945c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123292024-12-21T06:27:29.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2241 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9cda7621-2713-4c5e-a53f-c1104c94945c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
123302024-12-21T06:27:30.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
123312024-12-21T06:27:30.349ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
123322024-12-21T06:27:30.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
123332024-12-21T06:27:30.349ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
123342024-12-21T06:27:30.349ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
123352024-12-21T06:27:30.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
123362024-12-21T06:27:30.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123372024-12-21T06:27:30.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
123382024-12-21T06:27:30.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
123392024-12-21T06:27:30.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123402024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
123412024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123422024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
123432024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123442024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
123452024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
123462024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
123472024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
123482024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123492024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123502024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
123512024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
123522024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
123532024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
123542024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123552024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
123562024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123572024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123582024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
123592024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123602024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123612024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123622024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123632024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
123642024-12-21T06:27:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123652024-12-21T06:27:30.352ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1781, tv_nsec: 438144040 } })
123662024-12-21T06:27:30.352ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
123672024-12-21T06:27:30.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123682024-12-21T06:27:30.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1781, tv_nsec: 439113086 } })
123692024-12-21T06:27:30.353ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.450864ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
123702024-12-21T06:27:30.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
123712024-12-21T06:27:30.354ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123722024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
123732024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
123742024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
123752024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
123762024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
123772024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
123782024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
123792024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
123802024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
123812024-12-21T06:27:30.355ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
123822024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123832024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123842024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
123852024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123862024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
123872024-12-21T06:27:30.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
123882024-12-21T06:27:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
123892024-12-21T06:27:30.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123902024-12-21T06:27:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123912024-12-21T06:27:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
123922024-12-21T06:27:30.357ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123932024-12-21T06:27:30.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123942024-12-21T06:27:30.360ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
123952024-12-21T06:27:30.360ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
123962024-12-21T06:27:30.360ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123972024-12-21T06:27:30.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123982024-12-21T06:27:30.361ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.143881ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
123992024-12-21T06:27:30.362ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124002024-12-21T06:27:30.362ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124012024-12-21T06:27:30.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124022024-12-21T06:27:30.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124032024-12-21T06:27:30.363ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124042024-12-21T06:27:30.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124052024-12-21T06:27:30.386ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124062024-12-21T06:27:30.386ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124072024-12-21T06:27:30.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
124082024-12-21T06:27:30.389ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124092024-12-21T06:27:30.389ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
124102024-12-21T06:27:30.389ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
124112024-12-21T06:27:30.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124122024-12-21T06:27:30.389ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124132024-12-21T06:27:30.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
124142024-12-21T06:27:30.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124152024-12-21T06:27:30.390ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 34.96875ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
124162024-12-21T06:27:30.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124172024-12-21T06:27:30.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124182024-12-21T06:27:30.391ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124192024-12-21T06:27:30.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124202024-12-21T06:27:30.393ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124212024-12-21T06:27:30.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124222024-12-21T06:27:30.393ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124232024-12-21T06:27:30.394ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
124242024-12-21T06:27:30.394ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
124252024-12-21T06:27:30.394ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
124262024-12-21T06:27:30.394ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124272024-12-21T06:27:30.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
124282024-12-21T06:27:30.395ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.736181ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
124292024-12-21T06:27:30.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
124302024-12-21T06:27:30.396ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124312024-12-21T06:27:30.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124322024-12-21T06:27:30.396ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
124332024-12-21T06:27:30.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
124342024-12-21T06:27:30.397ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
124352024-12-21T06:27:30.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
124362024-12-21T06:27:30.398ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.622141ms iteration = 28 status = 0
124372024-12-21T06:27:30.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
124382024-12-21T06:27:30.398ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124392024-12-21T06:27:30.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124402024-12-21T06:27:30.400ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 44.668559ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
124412024-12-21T06:27:30.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124422024-12-21T06:27:30.400ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
124432024-12-21T06:27:30.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
124442024-12-21T06:27:30.401ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
124452024-12-21T06:27:30.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
124462024-12-21T06:27:30.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124472024-12-21T06:27:30.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
124482024-12-21T06:27:30.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124492024-12-21T06:27:30.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124502024-12-21T06:27:30.403ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 53.139294ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
124512024-12-21T06:27:30.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
124522024-12-21T06:27:30.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124532024-12-21T06:27:30.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124542024-12-21T06:27:30.412ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1781, tv_nsec: 497651790 } })
124552024-12-21T06:27:30.412ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
124562024-12-21T06:27:30.423ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
124572024-12-21T06:27:30.423ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 74.014243ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
124582024-12-21T06:27:30.430ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
124592024-12-21T06:27:30.430ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124602024-12-21T06:27:30.431ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
124612024-12-21T06:27:30.431ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124622024-12-21T06:27:30.431ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8b70bbb-fcf3-4db5-935b-efe2d9b880bf", "content-length": "26", "date": "Sat, 21 Dec 2024 06:27:30 GMT"} })
124632024-12-21T06:27:30.431ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124642024-12-21T06:27:30.431ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b225942f-9096-4e5d-aec6-cd3d1e5865b9", "content-length": "26", "date": "Sat, 21 Dec 2024 06:27:30 GMT"} })
124652024-12-21T06:27:30.431ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124662024-12-21T06:27:30.433ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
124672024-12-21T06:27:30.433ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
124682024-12-21T06:27:30.435ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124692024-12-21T06:27:30.437ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
124702024-12-21T06:27:30.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124712024-12-21T06:27:30.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124722024-12-21T06:27:30.440ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
124732024-12-21T06:27:30.440ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.904203ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
124742024-12-21T06:27:30.440ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
124752024-12-21T06:27:30.440ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
124762024-12-21T06:27:30.440ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.12587ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
124772024-12-21T06:27:30.445ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 89.881103ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
124782024-12-21T06:27:30.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124792024-12-21T06:27:30.451ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
124802024-12-21T06:27:30.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124812024-12-21T06:27:30.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124822024-12-21T06:27:30.466ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124832024-12-21T06:27:30.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124842024-12-21T06:27:30.476ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 126.263972ms iteration = 32 status = {"physical_disks_added":0}
124852024-12-21T06:27:30.488ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
124862024-12-21T06:27:30.488ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
124872024-12-21T06:27:30.489ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "680a3b55-72f3-4e01-b117-ce29f286c0bd", "content-length": "26", "date": "Sat, 21 Dec 2024 06:27:30 GMT"} })
124882024-12-21T06:27:30.489ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
124892024-12-21T06:27:30.490ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
124902024-12-21T06:27:30.497ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124912024-12-21T06:27:30.499ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124922024-12-21T06:27:30.499ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124932024-12-21T06:27:30.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124942024-12-21T06:27:30.501ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124952024-12-21T06:27:30.503ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
124962024-12-21T06:27:30.503ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124972024-12-21T06:27:30.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124982024-12-21T06:27:30.518ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 168.74516ms iteration = 28 status = {}
124992024-12-21T06:27:30.522ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
125002024-12-21T06:27:30.522ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b44b4e44-ce1c-4451-a1e9-5c9273ff1012", "content-length": "2", "date": "Sat, 21 Dec 2024 06:27:30 GMT"} })
125012024-12-21T06:27:30.524ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
125022024-12-21T06:27:30.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
125032024-12-21T06:27:30.526ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 177.73097ms iteration = 28 status = null
125042024-12-21T06:27:30.656ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
125052024-12-21T06:27:30.656ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dbaf535-3e24-464c-a2e1-50a14106d633", "content-length": "691", "date": "Sat, 21 Dec 2024 06:27:30 GMT"} })
125062024-12-21T06:27:30.656ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
125072024-12-21T06:27:30.656ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
125082024-12-21T06:27:30.656ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
125092024-12-21T06:27:30.657ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 307.316053ms iteration = 29 status = {}
125102024-12-21T06:27:30.679ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
125112024-12-21T06:27:30.679ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
125122024-12-21T06:27:30.679ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d05874f0-2ba3-43d1-8301-ac7b2527c85a", "content-length": "372", "date": "Sat, 21 Dec 2024 06:27:30 GMT"} })
125132024-12-21T06:27:30.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125142024-12-21T06:27:30.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125152024-12-21T06:27:30.719ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
125162024-12-21T06:27:30.719ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
125172024-12-21T06:27:30.719ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2bbaa192-2004-4180-b77d-ccb247d0e7bc", "date": "Sat, 21 Dec 2024 06:27:30 GMT"} })
125182024-12-21T06:27:30.719ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125192024-12-21T06:27:30.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125202024-12-21T06:27:30.722ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125212024-12-21T06:27:30.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125222024-12-21T06:27:30.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125232024-12-21T06:27:30.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125242024-12-21T06:27:30.728ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
125252024-12-21T06:27:30.728ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
125262024-12-21T06:27:30.729ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dcf75446-874e-428d-95e5-526d1a9c0cb5", "date": "Sat, 21 Dec 2024 06:27:30 GMT"} })
125272024-12-21T06:27:30.730ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 375.251587ms iteration = 30 status = {}
125282024-12-21T06:27:30.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125292024-12-21T06:27:30.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125302024-12-21T06:27:30.736ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
125312024-12-21T06:27:30.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125322024-12-21T06:27:30.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125332024-12-21T06:27:30.746ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
125342024-12-21T06:27:30.746ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3b73668-d4d3-42a7-93c1-af3e622d2fd7", "content-length": "134", "date": "Sat, 21 Dec 2024 06:27:30 GMT"} })
125352024-12-21T06:27:30.747ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
125362024-12-21T06:27:30.747ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
125372024-12-21T06:27:30.747ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
125382024-12-21T06:27:30.747ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
125392024-12-21T06:27:30.747ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
125402024-12-21T06:27:30.747ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
125412024-12-21T06:27:30.747ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
125422024-12-21T06:27:30.747ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
125432024-12-21T06:27:30.747ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
125442024-12-21T06:27:30.747ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
125452024-12-21T06:27:30.747ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
125462024-12-21T06:27:30.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125472024-12-21T06:27:30.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125482024-12-21T06:27:30.749ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
125492024-12-21T06:27:30.750ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "14bd64f5-cb60-4626-b7dc-a5163e77209c", "content-length": "2", "date": "Sat, 21 Dec 2024 06:27:30 GMT"} })
125502024-12-21T06:27:30.750ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
125512024-12-21T06:27:30.750ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5315f12d-f353-406c-bb4f-92f3137daffe", "content-length": "52", "date": "Sat, 21 Dec 2024 06:27:30 GMT"} })
125522024-12-21T06:27:30.750ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
125532024-12-21T06:27:30.750ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
125542024-12-21T06:27:30.842ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c7cb8451-9a37-4f30-a5d0-dd6fb1ef22ad", "date": "Sat, 21 Dec 2024 06:27:30 GMT"} })
125552024-12-21T06:27:30.842ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
125562024-12-21T06:27:30.842ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
125572024-12-21T06:27:30.842ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "36b95aff-6f78-4f77-bb0a-6cca1ae1d94c", "content-length": "682", "date": "Sat, 21 Dec 2024 06:27:30 GMT"} })
125582024-12-21T06:27:30.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125592024-12-21T06:27:30.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125602024-12-21T06:27:30.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125612024-12-21T06:27:30.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125622024-12-21T06:27:30.850ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125632024-12-21T06:27:30.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125642024-12-21T06:27:30.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
125652024-12-21T06:27:30.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
125662024-12-21T06:27:30.859ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 509.337186ms iteration = 28 status = {}
125672024-12-21T06:27:30.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d3ae57ea-36d4-40aa-bfc1-629776636dd8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125682024-12-21T06:27:30.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d3ae57ea-36d4-40aa-bfc1-629776636dd8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125692024-12-21T06:27:30.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d3ae57ea-36d4-40aa-bfc1-629776636dd8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125702024-12-21T06:27:31.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7c2a2e33-fc7e-4889-ab35-3d2f4fd78fc1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125712024-12-21T06:27:31.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7c2a2e33-fc7e-4889-ab35-3d2f4fd78fc1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125722024-12-21T06:27:31.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7c2a2e33-fc7e-4889-ab35-3d2f4fd78fc1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125732024-12-21T06:27:32.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e8597f5c-acbe-4bc5-9752-3d9ecc29ad5d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125742024-12-21T06:27:32.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e8597f5c-acbe-4bc5-9752-3d9ecc29ad5d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125752024-12-21T06:27:32.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2784 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e8597f5c-acbe-4bc5-9752-3d9ecc29ad5d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125762024-12-21T06:27:33.967ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1366 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 2b4f17ac-9b11-4e4a-9b79-0b30864be7cc response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
125772024-12-21T06:27:33.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3c435d01-44f5-4116-b871-cfee31947bde roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125782024-12-21T06:27:33.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3c435d01-44f5-4116-b871-cfee31947bde resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125792024-12-21T06:27:33.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3c435d01-44f5-4116-b871-cfee31947bde response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125802024-12-21T06:27:34.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a51d8f7a-c136-4722-a852-9bb29939531b roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125812024-12-21T06:27:34.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a51d8f7a-c136-4722-a852-9bb29939531b resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125822024-12-21T06:27:34.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a51d8f7a-c136-4722-a852-9bb29939531b response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125832024-12-21T06:27:36.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = edf631b8-9c67-4ee4-a0b2-df728eabc213 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125842024-12-21T06:27:36.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = edf631b8-9c67-4ee4-a0b2-df728eabc213 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125852024-12-21T06:27:36.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = edf631b8-9c67-4ee4-a0b2-df728eabc213 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125862024-12-21T06:27:37.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f588cbb5-3f86-4ab6-8e0a-fb34845ded64 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125872024-12-21T06:27:37.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f588cbb5-3f86-4ab6-8e0a-fb34845ded64 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125882024-12-21T06:27:37.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f588cbb5-3f86-4ab6-8e0a-fb34845ded64 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125892024-12-21T06:27:38.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 87171bf9-17cb-420e-ba61-7385d4153bed roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125902024-12-21T06:27:38.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 87171bf9-17cb-420e-ba61-7385d4153bed resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125912024-12-21T06:27:38.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2597 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 87171bf9-17cb-420e-ba61-7385d4153bed response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125922024-12-21T06:27:39.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7b618d28-67ec-49fe-bde0-3720864462c7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125932024-12-21T06:27:39.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7b618d28-67ec-49fe-bde0-3720864462c7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125942024-12-21T06:27:39.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7b618d28-67ec-49fe-bde0-3720864462c7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125952024-12-21T06:27:40.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5896fbbf-09d6-4c62-a3cb-299f36ea848a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125962024-12-21T06:27:40.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5896fbbf-09d6-4c62-a3cb-299f36ea848a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125972024-12-21T06:27:40.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2791 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5896fbbf-09d6-4c62-a3cb-299f36ea848a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
125982024-12-21T06:27:40.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
125992024-12-21T06:27:40.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126002024-12-21T06:27:40.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126012024-12-21T06:27:40.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
126022024-12-21T06:27:40.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126032024-12-21T06:27:40.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126042024-12-21T06:27:40.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126052024-12-21T06:27:40.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
126062024-12-21T06:27:40.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126072024-12-21T06:27:40.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126082024-12-21T06:27:40.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126092024-12-21T06:27:40.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126102024-12-21T06:27:40.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126112024-12-21T06:27:40.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
126122024-12-21T06:27:40.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126132024-12-21T06:27:40.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126142024-12-21T06:27:40.373ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
126152024-12-21T06:27:40.373ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.232822ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
126162024-12-21T06:27:40.379ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126172024-12-21T06:27:40.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126182024-12-21T06:27:40.408ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.537246ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
126192024-12-21T06:27:41.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 739244c8-e77c-4aad-8a78-81cde8ab6402 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126202024-12-21T06:27:41.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 739244c8-e77c-4aad-8a78-81cde8ab6402 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126212024-12-21T06:27:41.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1792 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 739244c8-e77c-4aad-8a78-81cde8ab6402 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126222024-12-21T06:27:41.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = bd283456-9df2-4675-91cd-59300929a8f8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
126232024-12-21T06:27:41.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = bd283456-9df2-4675-91cd-59300929a8f8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
126242024-12-21T06:27:41.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3368 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = bd283456-9df2-4675-91cd-59300929a8f8 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
126252024-12-21T06:27:42.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 425583b1-734d-4b59-a19f-fbb2d232ce61 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126262024-12-21T06:27:42.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 425583b1-734d-4b59-a19f-fbb2d232ce61 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126272024-12-21T06:27:42.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 425583b1-734d-4b59-a19f-fbb2d232ce61 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126282024-12-21T06:27:43.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c9455bcd-97c0-4a71-b7e2-48e48a5ea618 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126292024-12-21T06:27:43.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c9455bcd-97c0-4a71-b7e2-48e48a5ea618 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126302024-12-21T06:27:43.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c9455bcd-97c0-4a71-b7e2-48e48a5ea618 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126312024-12-21T06:27:43.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = bd8e33d5-5673-492c-979b-9dadf9e6aec7 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
126322024-12-21T06:27:43.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = bd8e33d5-5673-492c-979b-9dadf9e6aec7 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
126332024-12-21T06:27:43.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3594 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = bd8e33d5-5673-492c-979b-9dadf9e6aec7 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
126342024-12-21T06:27:43.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = eaa0cf2d-99f2-47cf-b055-89ebf3f1a24c roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
126352024-12-21T06:27:43.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = eaa0cf2d-99f2-47cf-b055-89ebf3f1a24c resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
126362024-12-21T06:27:43.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2470 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = eaa0cf2d-99f2-47cf-b055-89ebf3f1a24c response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
126372024-12-21T06:27:43.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1722 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 882ac7f4-3e50-4565-8ac8-16b0b8f5d207 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
126382024-12-21T06:27:44.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b3b7b544-9f9b-4ff2-a657-c301cd93f871 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126392024-12-21T06:27:44.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b3b7b544-9f9b-4ff2-a657-c301cd93f871 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126402024-12-21T06:27:44.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2616 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b3b7b544-9f9b-4ff2-a657-c301cd93f871 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126412024-12-21T06:27:45.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95b3e4a8-7501-4c67-a38c-4e8862526e2c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126422024-12-21T06:27:45.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95b3e4a8-7501-4c67-a38c-4e8862526e2c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126432024-12-21T06:27:45.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 95b3e4a8-7501-4c67-a38c-4e8862526e2c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126442024-12-21T06:27:46.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7b2f061b-c56b-4642-bc91-f86fc981f89a roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126452024-12-21T06:27:46.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7b2f061b-c56b-4642-bc91-f86fc981f89a resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126462024-12-21T06:27:46.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 7b2f061b-c56b-4642-bc91-f86fc981f89a response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126472024-12-21T06:27:47.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5bf62700-094c-47e8-a867-d9c0be87db5d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126482024-12-21T06:27:47.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5bf62700-094c-47e8-a867-d9c0be87db5d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126492024-12-21T06:27:47.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2416 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5bf62700-094c-47e8-a867-d9c0be87db5d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126502024-12-21T06:27:48.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6587222-a006-4e02-8b2f-0f51cef3a8dc roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126512024-12-21T06:27:48.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6587222-a006-4e02-8b2f-0f51cef3a8dc resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126522024-12-21T06:27:48.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2669 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f6587222-a006-4e02-8b2f-0f51cef3a8dc response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126532024-12-21T06:27:49.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a435cfd4-b074-4ba3-be47-c6157918f017 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126542024-12-21T06:27:49.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a435cfd4-b074-4ba3-be47-c6157918f017 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126552024-12-21T06:27:49.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a435cfd4-b074-4ba3-be47-c6157918f017 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126562024-12-21T06:27:50.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = da229818-aa5c-4bc4-8912-dc45f0ac95b8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126572024-12-21T06:27:50.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = da229818-aa5c-4bc4-8912-dc45f0ac95b8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126582024-12-21T06:27:50.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = da229818-aa5c-4bc4-8912-dc45f0ac95b8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126592024-12-21T06:27:50.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
126602024-12-21T06:27:50.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126612024-12-21T06:27:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126622024-12-21T06:27:50.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
126632024-12-21T06:27:50.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126642024-12-21T06:27:50.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126652024-12-21T06:27:50.352ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126662024-12-21T06:27:50.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126672024-12-21T06:27:50.354ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.975631ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
126682024-12-21T06:27:50.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126692024-12-21T06:27:50.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
126702024-12-21T06:27:50.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126712024-12-21T06:27:50.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126722024-12-21T06:27:50.391ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126732024-12-21T06:27:50.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126742024-12-21T06:27:50.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126752024-12-21T06:27:50.395ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
126762024-12-21T06:27:50.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126772024-12-21T06:27:50.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126782024-12-21T06:27:50.404ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
126792024-12-21T06:27:50.404ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.256225ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
126802024-12-21T06:27:51.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 74336ca5-d264-48a6-9b4e-47a4a991dee8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126812024-12-21T06:27:51.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 74336ca5-d264-48a6-9b4e-47a4a991dee8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126822024-12-21T06:27:51.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 74336ca5-d264-48a6-9b4e-47a4a991dee8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126832024-12-21T06:27:52.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 042b69ad-5e0f-4b71-bcc2-a4f6287d8bc6 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126842024-12-21T06:27:52.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 042b69ad-5e0f-4b71-bcc2-a4f6287d8bc6 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126852024-12-21T06:27:52.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 042b69ad-5e0f-4b71-bcc2-a4f6287d8bc6 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126862024-12-21T06:27:53.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5fb673a0-d234-40b0-956c-eda5660035f7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126872024-12-21T06:27:53.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5fb673a0-d234-40b0-956c-eda5660035f7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126882024-12-21T06:27:53.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 5fb673a0-d234-40b0-956c-eda5660035f7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126892024-12-21T06:27:53.967ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1260 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = d46e9262-9410-4b86-8308-3416eaebfcdb response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
126902024-12-21T06:27:54.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 83c340e3-1483-40f5-8af3-803d1f73d43d roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126912024-12-21T06:27:54.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 83c340e3-1483-40f5-8af3-803d1f73d43d resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126922024-12-21T06:27:54.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2626 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 83c340e3-1483-40f5-8af3-803d1f73d43d response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126932024-12-21T06:27:55.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 31778c75-4474-4ff9-8e41-b57f14fc6f84 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126942024-12-21T06:27:55.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 31778c75-4474-4ff9-8e41-b57f14fc6f84 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126952024-12-21T06:27:55.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 31778c75-4474-4ff9-8e41-b57f14fc6f84 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126962024-12-21T06:27:56.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 698a65bf-33f8-4518-8edb-cb83554d4f74 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126972024-12-21T06:27:56.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 698a65bf-33f8-4518-8edb-cb83554d4f74 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126982024-12-21T06:27:56.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 698a65bf-33f8-4518-8edb-cb83554d4f74 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
126992024-12-21T06:27:57.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3aa818a4-539b-4604-82c6-38c1bb0fab71 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
127002024-12-21T06:27:57.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3aa818a4-539b-4604-82c6-38c1bb0fab71 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
127012024-12-21T06:27:57.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1952 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3aa818a4-539b-4604-82c6-38c1bb0fab71 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
127022024-12-21T06:27:58.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1f80c888-d6ca-4a6a-9cdf-49f030218950 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
127032024-12-21T06:27:58.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1f80c888-d6ca-4a6a-9cdf-49f030218950 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
127042024-12-21T06:27:58.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 1f80c888-d6ca-4a6a-9cdf-49f030218950 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
127052024-12-21T06:27:59.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a2990a1-33b4-43ec-a954-76d94ba0efc1 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
127062024-12-21T06:27:59.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a2990a1-33b4-43ec-a954-76d94ba0efc1 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
127072024-12-21T06:27:59.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 2a2990a1-33b4-43ec-a954-76d94ba0efc1 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
127082024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
127092024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
127102024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
127112024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
127122024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
127132024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
127142024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
127152024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127162024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
127172024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
127182024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
127192024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
127202024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
127212024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
127222024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
127232024-12-21T06:28:00.349ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 7c419228-2431-4394-af83-ea0457364b70
127242024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.53\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"7c419228-2431-4394-af83-ea0457364b70"}
127252024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
127262024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
127272024-12-21T06:28:00.349ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-21 06:18:00.349809675 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
127282024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
127292024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
127302024-12-21T06:28:00.349ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
127312024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
127322024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127332024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
127342024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
127352024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127362024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
127372024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
127382024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
127392024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
127402024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
127412024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
127422024-12-21T06:28:00.350ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
127432024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127442024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
127452024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
127462024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127472024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
127482024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127492024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
127502024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127512024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127522024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
127532024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127542024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
127552024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
127562024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
127572024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
127582024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
127592024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
127602024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
127612024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127622024-12-21T06:28:00.350ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("48ca2ba5-fe26-4e4e-98d6-eba9e5a8d1aa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("621b6995-ee70-406d-a9fd-e26a95427f65.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1811, tv_nsec: 436007170 } })
127632024-12-21T06:28:00.350ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("068965c6-3480-4953-b57e-dd969abb2a21.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("45c0a855-5592-491c-b7b3-470902319db2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e4561faf-9014-49c3-a487-f7d3655c55fb.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1811, tv_nsec: 436011550 } })
127642024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127652024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127662024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
127672024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127682024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
127692024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
127702024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127712024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127722024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127732024-12-21T06:28:00.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
127742024-12-21T06:28:00.351ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
127752024-12-21T06:28:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.292876ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
127762024-12-21T06:28:00.351ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
127772024-12-21T06:28:00.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.338817ms iteration = 16 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
127782024-12-21T06:28:00.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
127792024-12-21T06:28:00.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
127802024-12-21T06:28:00.352ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1811, tv_nsec: 437841651 } })
127812024-12-21T06:28:00.352ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
127822024-12-21T06:28:00.352ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127832024-12-21T06:28:00.353ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127842024-12-21T06:28:00.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1811, tv_nsec: 439381384 } })
127852024-12-21T06:28:00.354ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.439473ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
127862024-12-21T06:28:00.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127872024-12-21T06:28:00.354ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
127882024-12-21T06:28:00.354ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127892024-12-21T06:28:00.354ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-21 06:18:00.349809675 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
127902024-12-21T06:28:00.354ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.05375ms iteration = 15 status = {"expiration":"2024-12-21T06:18:00.349809675Z","pruned":[]}
127912024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
127922024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
127932024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
127942024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
127952024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
127962024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
127972024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
127982024-12-21T06:28:00.355ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
127992024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128002024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
128012024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
128022024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
128032024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
128042024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
128052024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
128062024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
128072024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
128082024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128092024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
128102024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
128112024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
128122024-12-21T06:28:00.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
128132024-12-21T06:28:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
128142024-12-21T06:28:00.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128152024-12-21T06:28:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128162024-12-21T06:28:00.356ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
128172024-12-21T06:28:00.356ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128182024-12-21T06:28:00.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128192024-12-21T06:28:00.359ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128202024-12-21T06:28:00.360ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128212024-12-21T06:28:00.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
128222024-12-21T06:28:00.361ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
128232024-12-21T06:28:00.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
128242024-12-21T06:28:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
128252024-12-21T06:28:00.363ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128262024-12-21T06:28:00.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128272024-12-21T06:28:00.365ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.581373ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
128282024-12-21T06:28:00.366ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128292024-12-21T06:28:00.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128302024-12-21T06:28:00.368ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128312024-12-21T06:28:00.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128322024-12-21T06:28:00.402ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128332024-12-21T06:28:00.402ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128342024-12-21T06:28:00.402ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
128352024-12-21T06:28:00.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
128362024-12-21T06:28:00.403ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128372024-12-21T06:28:00.404ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128382024-12-21T06:28:00.406ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.20067ms iteration = 29 status = {"errors":[],"finish_invoked_ok":[]}
128392024-12-21T06:28:00.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
128402024-12-21T06:28:00.406ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
128412024-12-21T06:28:00.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128422024-12-21T06:28:00.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128432024-12-21T06:28:00.407ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
128442024-12-21T06:28:00.407ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
128452024-12-21T06:28:00.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
128462024-12-21T06:28:00.409ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128472024-12-21T06:28:00.409ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128482024-12-21T06:28:00.409ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
128492024-12-21T06:28:00.409ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
128502024-12-21T06:28:00.409ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128512024-12-21T06:28:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
128522024-12-21T06:28:00.409ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128532024-12-21T06:28:00.409ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128542024-12-21T06:28:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128552024-12-21T06:28:00.409ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128562024-12-21T06:28:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128572024-12-21T06:28:00.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
128582024-12-21T06:28:00.409ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128592024-12-21T06:28:00.410ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
128602024-12-21T06:28:00.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128612024-12-21T06:28:00.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
128622024-12-21T06:28:00.410ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 55.575522ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
128632024-12-21T06:28:00.411ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1811, tv_nsec: 497245499 } })
128642024-12-21T06:28:00.412ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
128652024-12-21T06:28:00.412ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
128662024-12-21T06:28:00.412ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128672024-12-21T06:28:00.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128682024-12-21T06:28:00.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
128692024-12-21T06:28:00.413ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128702024-12-21T06:28:00.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128712024-12-21T06:28:00.413ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
128722024-12-21T06:28:00.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128732024-12-21T06:28:00.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128742024-12-21T06:28:00.416ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128752024-12-21T06:28:00.417ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
128762024-12-21T06:28:00.417ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
128772024-12-21T06:28:00.417ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.156074ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
128782024-12-21T06:28:00.417ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128792024-12-21T06:28:00.418ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
128802024-12-21T06:28:00.418ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128812024-12-21T06:28:00.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128822024-12-21T06:28:00.420ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
128832024-12-21T06:28:00.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128842024-12-21T06:28:00.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128852024-12-21T06:28:00.421ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
128862024-12-21T06:28:00.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
128872024-12-21T06:28:00.431ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
128882024-12-21T06:28:00.431ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.246094ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
128892024-12-21T06:28:00.432ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
128902024-12-21T06:28:00.432ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.595031ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
128912024-12-21T06:28:00.440ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
128922024-12-21T06:28:00.440ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
128932024-12-21T06:28:00.440ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
128942024-12-21T06:28:00.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128952024-12-21T06:28:00.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128962024-12-21T06:28:00.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128972024-12-21T06:28:00.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128982024-12-21T06:28:00.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128992024-12-21T06:28:00.444ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129002024-12-21T06:28:00.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
129012024-12-21T06:28:00.445ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129022024-12-21T06:28:00.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129032024-12-21T06:28:00.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
129042024-12-21T06:28:00.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
129052024-12-21T06:28:00.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.373001ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
129062024-12-21T06:28:00.447ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
129072024-12-21T06:28:00.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
129082024-12-21T06:28:00.448ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129092024-12-21T06:28:00.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
129102024-12-21T06:28:00.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129112024-12-21T06:28:00.449ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
129122024-12-21T06:28:00.449ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
129132024-12-21T06:28:00.449ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 98.7848ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
129142024-12-21T06:28:00.451ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.805486ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
129152024-12-21T06:28:00.456ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129162024-12-21T06:28:00.456ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
129172024-12-21T06:28:00.456ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129182024-12-21T06:28:00.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129192024-12-21T06:28:00.457ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 102.322528ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
129202024-12-21T06:28:00.459ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
129212024-12-21T06:28:00.459ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
129222024-12-21T06:28:00.459ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
129232024-12-21T06:28:00.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129242024-12-21T06:28:00.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129252024-12-21T06:28:00.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129262024-12-21T06:28:00.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129272024-12-21T06:28:00.518ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
129282024-12-21T06:28:00.527ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
129292024-12-21T06:28:00.529ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 178.968543ms iteration = 33 status = {"physical_disks_added":0}
129302024-12-21T06:28:00.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ca6e92a7-4d93-485b-9210-38d108384da4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
129312024-12-21T06:28:00.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ca6e92a7-4d93-485b-9210-38d108384da4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
129322024-12-21T06:28:00.570ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
129332024-12-21T06:28:00.570ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129342024-12-21T06:28:00.570ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "77667675-1852-4f54-8547-035ddff4e2fd", "content-length": "26", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} })
129352024-12-21T06:28:00.570ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129362024-12-21T06:28:00.572ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
129372024-12-21T06:28:00.589ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
129382024-12-21T06:28:00.589ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
129392024-12-21T06:28:00.589ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0520b08f-ae67-47de-bd5e-c8ee5d2a1b69", "content-length": "372", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} })
129402024-12-21T06:28:00.589ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129412024-12-21T06:28:00.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129422024-12-21T06:28:00.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129432024-12-21T06:28:00.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129442024-12-21T06:28:00.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129452024-12-21T06:28:00.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ca6e92a7-4d93-485b-9210-38d108384da4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
129462024-12-21T06:28:00.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
129472024-12-21T06:28:00.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129482024-12-21T06:28:00.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129492024-12-21T06:28:00.624ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129502024-12-21T06:28:00.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129512024-12-21T06:28:00.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 269.968478ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
129522024-12-21T06:28:00.629ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
129532024-12-21T06:28:00.629ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
129542024-12-21T06:28:00.629ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129552024-12-21T06:28:00.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129562024-12-21T06:28:00.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129572024-12-21T06:28:00.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
129582024-12-21T06:28:00.635ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129592024-12-21T06:28:00.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129602024-12-21T06:28:00.638ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129612024-12-21T06:28:00.638ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 267c8137-6c8c-41fd-bcd5-55afc9db5213 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
129622024-12-21T06:28:00.638ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
129632024-12-21T06:28:00.638ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-21 06:14:07.931887 UTC dns_group = internal generation = 1
129642024-12-21T06:28:00.638ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 288.864932ms iteration = 16 status = {"generation":1}
129652024-12-21T06:28:00.638ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
129662024-12-21T06:28:00.638ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 0 version = 2
129672024-12-21T06:28:00.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129682024-12-21T06:28:00.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129692024-12-21T06:28:00.640ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129702024-12-21T06:28:00.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
129712024-12-21T06:28:00.640ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129722024-12-21T06:28:00.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129732024-12-21T06:28:00.642ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129742024-12-21T06:28:00.642ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
129752024-12-21T06:28:00.642ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 292.247566ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
129762024-12-21T06:28:00.643ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 292.951475ms iteration = 29 status = 0
129772024-12-21T06:28:00.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
129782024-12-21T06:28:00.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129792024-12-21T06:28:00.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129802024-12-21T06:28:00.646ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 6843e72c-f2c5-4ed3-8998-e1c5f42bcfea dns_zone_name = oxide.test found_so_far = 1 version = 2
129812024-12-21T06:28:00.646ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
129822024-12-21T06:28:00.646ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-21 06:14:08.776888 UTC dns_group = external generation = 2
129832024-12-21T06:28:00.646ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 297.014088ms iteration = 16 status = {"generation":2}
129842024-12-21T06:28:00.648ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
129852024-12-21T06:28:00.648ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
129862024-12-21T06:28:00.648ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7ef81309-3165-43d6-a12c-d7a0345977c8", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} })
129872024-12-21T06:28:00.648ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129882024-12-21T06:28:00.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129892024-12-21T06:28:00.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129902024-12-21T06:28:00.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129912024-12-21T06:28:00.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129922024-12-21T06:28:00.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129932024-12-21T06:28:00.656ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
129942024-12-21T06:28:00.656ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129952024-12-21T06:28:00.656ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6e52930-727c-4ae1-a7fc-6c3b89c455b1", "content-length": "26", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} })
129962024-12-21T06:28:00.656ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129972024-12-21T06:28:00.658ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
129982024-12-21T06:28:00.658ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
129992024-12-21T06:28:00.658ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bf97a99a-d00c-42cf-abc3-fde922ccf413", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} })
130002024-12-21T06:28:00.658ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
130012024-12-21T06:28:00.659ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
130022024-12-21T06:28:00.659ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130032024-12-21T06:28:00.659ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b6950c40-c256-4585-a1b6-651dc5c63e4e", "content-length": "26", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} })
130042024-12-21T06:28:00.659ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
130052024-12-21T06:28:00.660ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 305.079191ms iteration = 31 status = {}
130062024-12-21T06:28:00.661ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
130072024-12-21T06:28:00.662ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130082024-12-21T06:28:00.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
130092024-12-21T06:28:00.664ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
130102024-12-21T06:28:00.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
130112024-12-21T06:28:00.679ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
130122024-12-21T06:28:00.679ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
130132024-12-21T06:28:00.680ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "bdab0f57-e820-4a71-a65d-5080543c44c5", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130142024-12-21T06:28:00.680ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130152024-12-21T06:28:00.682ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5feba4d3-a3ed-4f8b-8242-b71801ee54ed", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130162024-12-21T06:28:00.682ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130172024-12-21T06:28:00.684ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
130182024-12-21T06:28:00.684ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 334.520678ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
130192024-12-21T06:28:00.690ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
130202024-12-21T06:28:00.690ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 340.36751ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
130212024-12-21T06:28:00.699ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-21T06:13:58.796551Z, time_modified: 2024-12-21T06:13:58.796551Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9fdab129-17d4-458d-9c79-06068bd8b11c, db_silo: Silo { identity: SiloIdentity { id: 9fdab129-17d4-458d-9c79-06068bd8b11c, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-21T06:14:08.717983Z, time_modified: 2024-12-21T06:14:08.717983Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac" }] }) }
130222024-12-21T06:28:00.699ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 349.36462ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]}},"default_endpoint":{"silo_id":"9fdab129-17d4-458d-9c79-06068bd8b11c","tls_certs":["8b62dec6a7aa3ecf75de80862b0a161ba7cb803ed2c77e765a8dba0f880068ac"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
130232024-12-21T06:28:00.719ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130242024-12-21T06:28:00.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130252024-12-21T06:28:00.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130262024-12-21T06:28:00.723ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
130272024-12-21T06:28:00.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130282024-12-21T06:28:00.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130292024-12-21T06:28:00.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130302024-12-21T06:28:00.727ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
130312024-12-21T06:28:00.727ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130322024-12-21T06:28:00.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130332024-12-21T06:28:00.750ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
130342024-12-21T06:28:00.751ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ba6ef3a-322b-459d-aba9-6783cd47723a", "content-length": "2", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} })
130352024-12-21T06:28:00.752ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
130362024-12-21T06:28:00.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
130372024-12-21T06:28:00.754ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 404.514269ms iteration = 29 status = null
130382024-12-21T06:28:00.760ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
130392024-12-21T06:28:00.760ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f202663f-6567-4ec3-9bfe-9c12e43cdbc1", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
130402024-12-21T06:28:00.760ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
130412024-12-21T06:28:00.762ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9b27db6a-3952-4d60-90cc-9777355371da", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
130422024-12-21T06:28:00.762ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
130432024-12-21T06:28:00.763ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1fd993f4-8a94-4ba2-9aa6-6a106e8d1454", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
130442024-12-21T06:28:00.763ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
130452024-12-21T06:28:00.765ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
130462024-12-21T06:28:00.765ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 415.529045ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
130472024-12-21T06:28:00.771ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 421.452229ms iteration = 29 status = {}
130482024-12-21T06:28:00.819ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
130492024-12-21T06:28:00.820ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130502024-12-21T06:28:00.820ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "26a650b3-3a1a-4768-9c63-424d34039450", "content-length": "691", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} })
130512024-12-21T06:28:00.820ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
130522024-12-21T06:28:00.820ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
130532024-12-21T06:28:00.820ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
130542024-12-21T06:28:00.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130552024-12-21T06:28:00.821ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 470.707575ms iteration = 30 status = {}
130562024-12-21T06:28:00.822ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
130572024-12-21T06:28:00.822ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130582024-12-21T06:28:00.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130592024-12-21T06:28:00.832ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
130602024-12-21T06:28:00.833ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a60f3a6d-be4b-42c1-a0ea-1a19aab2ad9b", "content-length": "134", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} })
130612024-12-21T06:28:00.833ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
130622024-12-21T06:28:00.833ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
130632024-12-21T06:28:00.833ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
130642024-12-21T06:28:00.833ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
130652024-12-21T06:28:00.833ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
130662024-12-21T06:28:00.833ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
130672024-12-21T06:28:00.833ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
130682024-12-21T06:28:00.833ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
130692024-12-21T06:28:00.833ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
130702024-12-21T06:28:00.833ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
130712024-12-21T06:28:00.833ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
130722024-12-21T06:28:00.833ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130732024-12-21T06:28:00.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130742024-12-21T06:28:00.835ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
130752024-12-21T06:28:00.835ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7683fa39-0206-498b-91dc-a1014e5c3e70", "content-length": "2", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} })
130762024-12-21T06:28:00.835ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
130772024-12-21T06:28:00.836ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "03d7c504-216c-4129-87d0-d1135eebf302", "content-length": "52", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} })
130782024-12-21T06:28:00.836ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
130792024-12-21T06:28:00.836ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
130802024-12-21T06:28:00.933ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e6d4521b-29db-4d47-a7b4-08e137311fef", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} })
130812024-12-21T06:28:00.934ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
130822024-12-21T06:28:00.934ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
130832024-12-21T06:28:00.934ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ee61d29-9442-407c-b7fb-00ae13081acf", "content-length": "682", "date": "Sat, 21 Dec 2024 06:28:00 GMT"} })
130842024-12-21T06:28:00.934ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130852024-12-21T06:28:00.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130862024-12-21T06:28:00.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130872024-12-21T06:28:00.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130882024-12-21T06:28:00.941ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130892024-12-21T06:28:00.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130902024-12-21T06:28:00.944ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130912024-12-21T06:28:00.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130922024-12-21T06:28:00.951ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 600.863525ms iteration = 29 status = {}
130932024-12-21T06:28:01.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cdd5c9cf-cb60-44e2-9620-fc26e6b8cceb roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
130942024-12-21T06:28:01.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cdd5c9cf-cb60-44e2-9620-fc26e6b8cceb resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
130952024-12-21T06:28:01.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = cdd5c9cf-cb60-44e2-9620-fc26e6b8cceb response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
130962024-12-21T06:28:02.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3b57c79a-ee8a-467b-86c2-0822434c589f roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
130972024-12-21T06:28:02.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3b57c79a-ee8a-467b-86c2-0822434c589f resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
130982024-12-21T06:28:02.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 3b57c79a-ee8a-467b-86c2-0822434c589f response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
130992024-12-21T06:28:03.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d2c57a0d-b5c9-4a66-a82c-f942253f0f4e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131002024-12-21T06:28:03.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d2c57a0d-b5c9-4a66-a82c-f942253f0f4e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131012024-12-21T06:28:03.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d2c57a0d-b5c9-4a66-a82c-f942253f0f4e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131022024-12-21T06:28:03.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1423 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = aa3c31e7-e39f-4d54-85a5-fe4424bf63b6 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
131032024-12-21T06:28:04.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = de624900-9ca6-4cab-b093-8671ece878f8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131042024-12-21T06:28:04.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = de624900-9ca6-4cab-b093-8671ece878f8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131052024-12-21T06:28:04.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = de624900-9ca6-4cab-b093-8671ece878f8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131062024-12-21T06:28:05.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9cbc7e80-0c0b-4d9b-8fbc-aa597ba12cf4 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131072024-12-21T06:28:05.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9cbc7e80-0c0b-4d9b-8fbc-aa597ba12cf4 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131082024-12-21T06:28:05.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9cbc7e80-0c0b-4d9b-8fbc-aa597ba12cf4 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131092024-12-21T06:28:06.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f65d177c-633a-4be4-936d-0556bff706a7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131102024-12-21T06:28:06.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f65d177c-633a-4be4-936d-0556bff706a7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131112024-12-21T06:28:06.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f65d177c-633a-4be4-936d-0556bff706a7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131122024-12-21T06:28:07.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d7a08128-3805-4692-ad00-cd5f91d750cf roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131132024-12-21T06:28:07.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d7a08128-3805-4692-ad00-cd5f91d750cf resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131142024-12-21T06:28:07.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d7a08128-3805-4692-ad00-cd5f91d750cf response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131152024-12-21T06:28:08.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4edb5d9c-bb7b-46c1-8d6c-828bd1992a94 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131162024-12-21T06:28:08.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4edb5d9c-bb7b-46c1-8d6c-828bd1992a94 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131172024-12-21T06:28:08.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4edb5d9c-bb7b-46c1-8d6c-828bd1992a94 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131182024-12-21T06:28:09.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9dce8ee5-59ed-41d4-bb59-ab28e767e4aa roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131192024-12-21T06:28:09.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9dce8ee5-59ed-41d4-bb59-ab28e767e4aa resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131202024-12-21T06:28:09.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 9dce8ee5-59ed-41d4-bb59-ab28e767e4aa response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131212024-12-21T06:28:10.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
131222024-12-21T06:28:10.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131232024-12-21T06:28:10.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131242024-12-21T06:28:10.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
131252024-12-21T06:28:10.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131262024-12-21T06:28:10.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131272024-12-21T06:28:10.351ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131282024-12-21T06:28:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
131292024-12-21T06:28:10.354ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131302024-12-21T06:28:10.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131312024-12-21T06:28:10.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131322024-12-21T06:28:10.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131332024-12-21T06:28:10.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131342024-12-21T06:28:10.361ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
131352024-12-21T06:28:10.361ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131362024-12-21T06:28:10.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131372024-12-21T06:28:10.373ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
131382024-12-21T06:28:10.373ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.866291ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
131392024-12-21T06:28:10.378ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131402024-12-21T06:28:10.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131412024-12-21T06:28:10.407ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.497537ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
131422024-12-21T06:28:10.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b182b0c1-c2c4-4ca1-89b4-92a0b991f2a8 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131432024-12-21T06:28:10.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b182b0c1-c2c4-4ca1-89b4-92a0b991f2a8 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131442024-12-21T06:28:10.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b182b0c1-c2c4-4ca1-89b4-92a0b991f2a8 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131452024-12-21T06:28:11.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 0ff3a50b-fead-4d71-87d1-53f40f56a216 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
131462024-12-21T06:28:11.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 0ff3a50b-fead-4d71-87d1-53f40f56a216 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
131472024-12-21T06:28:11.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3542 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:40234 req_id = 0ff3a50b-fead-4d71-87d1-53f40f56a216 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
131482024-12-21T06:28:11.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = db6ee3ed-93b9-485d-a735-273972d70004 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131492024-12-21T06:28:11.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = db6ee3ed-93b9-485d-a735-273972d70004 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131502024-12-21T06:28:11.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = db6ee3ed-93b9-485d-a735-273972d70004 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131512024-12-21T06:28:12.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ea980c10-589f-4a63-bed3-ee5240d84d29 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131522024-12-21T06:28:12.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ea980c10-589f-4a63-bed3-ee5240d84d29 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131532024-12-21T06:28:12.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ea980c10-589f-4a63-bed3-ee5240d84d29 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131542024-12-21T06:28:13.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b0cf5163-70b8-4a20-af4a-445a0b35d049 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131552024-12-21T06:28:13.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b0cf5163-70b8-4a20-af4a-445a0b35d049 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131562024-12-21T06:28:13.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1823 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b0cf5163-70b8-4a20-af4a-445a0b35d049 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131572024-12-21T06:28:13.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = ec470d5c-70c5-47e9-87fb-3864142eae31 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
131582024-12-21T06:28:13.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = ec470d5c-70c5-47e9-87fb-3864142eae31 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
131592024-12-21T06:28:13.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = ec470d5c-70c5-47e9-87fb-3864142eae31 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?sort_by=id_ascending
131602024-12-21T06:28:13.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = b9b7bba1-f15d-4369-8870-2fa1c56e3251 roles = RoleSet { roles: {} } uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
131612024-12-21T06:28:13.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = b9b7bba1-f15d-4369-8870-2fa1c56e3251 resource = Database result = Ok(()) uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
131622024-12-21T06:28:13.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1941 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:36058 req_id = b9b7bba1-f15d-4369-8870-2fa1c56e3251 response_code = 200 uri = /metrics/collectors/40f81c4f-7bfa-4222-940b-53f4f10b067d/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGQ1MWI0Mi1kMGRmLTQwZDctYjZhYy05ZDNkMDI5NjY1MGIifX0%3D
131632024-12-21T06:28:13.969ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1797 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = b0a90815-aeb4-45d8-816a-5bb2eb964c04 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
131642024-12-21T06:28:14.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4216af32-4b29-401c-940f-089e6bc71ab9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131652024-12-21T06:28:14.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4216af32-4b29-401c-940f-089e6bc71ab9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131662024-12-21T06:28:14.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2517 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 4216af32-4b29-401c-940f-089e6bc71ab9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131672024-12-21T06:28:15.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 63de367c-8c2c-4fd0-bb8d-d8a92efe9869 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131682024-12-21T06:28:15.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 63de367c-8c2c-4fd0-bb8d-d8a92efe9869 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131692024-12-21T06:28:15.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 63de367c-8c2c-4fd0-bb8d-d8a92efe9869 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131702024-12-21T06:28:16.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ddcdda1c-d5cd-4b78-8854-76c06fe1df5e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131712024-12-21T06:28:16.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ddcdda1c-d5cd-4b78-8854-76c06fe1df5e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131722024-12-21T06:28:16.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ddcdda1c-d5cd-4b78-8854-76c06fe1df5e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131732024-12-21T06:28:17.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ae05b0a4-e91a-472e-8844-6e5dd5f3f9ce roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131742024-12-21T06:28:17.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ae05b0a4-e91a-472e-8844-6e5dd5f3f9ce resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131752024-12-21T06:28:17.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2667 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ae05b0a4-e91a-472e-8844-6e5dd5f3f9ce response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131762024-12-21T06:28:18.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e87175a3-6878-4133-9a21-2d574acbe539 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131772024-12-21T06:28:18.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e87175a3-6878-4133-9a21-2d574acbe539 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131782024-12-21T06:28:18.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e87175a3-6878-4133-9a21-2d574acbe539 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131792024-12-21T06:28:20.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c218d817-d7b6-45ec-aa28-7e5de3af9f18 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131802024-12-21T06:28:20.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c218d817-d7b6-45ec-aa28-7e5de3af9f18 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131812024-12-21T06:28:20.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = c218d817-d7b6-45ec-aa28-7e5de3af9f18 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
131822024-12-21T06:28:20.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
131832024-12-21T06:28:20.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131842024-12-21T06:28:20.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131852024-12-21T06:28:20.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
131862024-12-21T06:28:20.351ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131872024-12-21T06:28:20.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131882024-12-21T06:28:20.353ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131892024-12-21T06:28:20.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131902024-12-21T06:28:20.355ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.326969ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
131912024-12-21T06:28:20.379ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131922024-12-21T06:28:20.382ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
131932024-12-21T06:28:20.382ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131942024-12-21T06:28:20.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131952024-12-21T06:28:20.383ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131962024-12-21T06:28:20.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131972024-12-21T06:28:20.385ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131982024-12-21T06:28:20.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
131992024-12-21T06:28:20.388ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132002024-12-21T06:28:20.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132012024-12-21T06:28:20.398ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
132022024-12-21T06:28:20.398ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.372599ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
132032024-12-21T06:28:21.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 729c2be4-1ee2-4fe9-b1a3-4056c4ee819c roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132042024-12-21T06:28:21.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 729c2be4-1ee2-4fe9-b1a3-4056c4ee819c resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132052024-12-21T06:28:21.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2206 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 729c2be4-1ee2-4fe9-b1a3-4056c4ee819c response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132062024-12-21T06:28:22.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 83c9ad37-c5e5-45d5-af55-3b62dd716ac7 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132072024-12-21T06:28:22.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 83c9ad37-c5e5-45d5-af55-3b62dd716ac7 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132082024-12-21T06:28:22.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2558 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 83c9ad37-c5e5-45d5-af55-3b62dd716ac7 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132092024-12-21T06:28:23.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 715ade04-cedd-43f8-989e-3e07404210e9 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132102024-12-21T06:28:23.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 715ade04-cedd-43f8-989e-3e07404210e9 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132112024-12-21T06:28:23.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 715ade04-cedd-43f8-989e-3e07404210e9 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132122024-12-21T06:28:23.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1634 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = 418135f8-b530-4347-8bab-5babc22074c7 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb
132132024-12-21T06:28:24.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b97ece9a-dc6d-45c7-aa22-96522e8c9159 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132142024-12-21T06:28:24.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b97ece9a-dc6d-45c7-aa22-96522e8c9159 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132152024-12-21T06:28:24.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = b97ece9a-dc6d-45c7-aa22-96522e8c9159 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132162024-12-21T06:28:25.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a775b0d7-9e59-425e-98f3-5f7ff1383830 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132172024-12-21T06:28:25.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a775b0d7-9e59-425e-98f3-5f7ff1383830 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132182024-12-21T06:28:25.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = a775b0d7-9e59-425e-98f3-5f7ff1383830 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132192024-12-21T06:28:26.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0720892a-b15d-474d-b14e-7cfd3b45f66e roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132202024-12-21T06:28:26.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0720892a-b15d-474d-b14e-7cfd3b45f66e resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132212024-12-21T06:28:26.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0720892a-b15d-474d-b14e-7cfd3b45f66e response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132222024-12-21T06:28:27.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 480423a8-eddb-4594-a1fa-66158c8d6e55 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132232024-12-21T06:28:27.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 480423a8-eddb-4594-a1fa-66158c8d6e55 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132242024-12-21T06:28:27.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 480423a8-eddb-4594-a1fa-66158c8d6e55 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132252024-12-21T06:28:28.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0e4aad32-619b-4ace-b337-3f7c67765f20 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132262024-12-21T06:28:28.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0e4aad32-619b-4ace-b337-3f7c67765f20 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132272024-12-21T06:28:28.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 0e4aad32-619b-4ace-b337-3f7c67765f20 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132282024-12-21T06:28:29.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e6ff77cc-66ea-49bd-80ad-d216a96138e0 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132292024-12-21T06:28:29.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e6ff77cc-66ea-49bd-80ad-d216a96138e0 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132302024-12-21T06:28:29.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2446 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = e6ff77cc-66ea-49bd-80ad-d216a96138e0 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132312024-12-21T06:28:30.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f98c778f-8a83-4aa2-9409-9ae5327b1a38 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132322024-12-21T06:28:30.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f98c778f-8a83-4aa2-9409-9ae5327b1a38 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132332024-12-21T06:28:30.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = f98c778f-8a83-4aa2-9409-9ae5327b1a38 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
132342024-12-21T06:28:30.349ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
132352024-12-21T06:28:30.349ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
132362024-12-21T06:28:30.349ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
132372024-12-21T06:28:30.349ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
132382024-12-21T06:28:30.349ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
132392024-12-21T06:28:30.349ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
132402024-12-21T06:28:30.349ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132412024-12-21T06:28:30.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
132422024-12-21T06:28:30.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
132432024-12-21T06:28:30.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132442024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
132452024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
132462024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
132472024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
132482024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132492024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132502024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 34 reason = Timeout
132512024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132522024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
132532024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132542024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
132552024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
132562024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 31 reason = Timeout
132572024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
132582024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
132592024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
132602024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132612024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132622024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132632024-12-21T06:28:30.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
132642024-12-21T06:28:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132652024-12-21T06:28:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
132662024-12-21T06:28:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132672024-12-21T06:28:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132682024-12-21T06:28:30.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132692024-12-21T06:28:30.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1841, tv_nsec: 438616084 } })
132702024-12-21T06:28:30.353ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1841, tv_nsec: 438957723 } })
132712024-12-21T06:28:30.353ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132722024-12-21T06:28:30.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
132732024-12-21T06:28:30.353ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
132742024-12-21T06:28:30.353ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.613118ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
132752024-12-21T06:28:30.355ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
132762024-12-21T06:28:30.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
132772024-12-21T06:28:30.355ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 32 reason = Timeout
132782024-12-21T06:28:30.356ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
132792024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132802024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
132812024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
132822024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
132832024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
132842024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
132852024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
132862024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132872024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132882024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
132892024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132902024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
132912024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
132922024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
132932024-12-21T06:28:30.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132942024-12-21T06:28:30.357ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132952024-12-21T06:28:30.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
132962024-12-21T06:28:30.359ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132972024-12-21T06:28:30.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132982024-12-21T06:28:30.361ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132992024-12-21T06:28:30.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133002024-12-21T06:28:30.362ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133012024-12-21T06:28:30.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133022024-12-21T06:28:30.364ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cf7f8320-e45e-46f1-aa3b-b101ce937c63.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1841, tv_nsec: 450357859 } })
133032024-12-21T06:28:30.365ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
133042024-12-21T06:28:30.370ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133052024-12-21T06:28:30.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133062024-12-21T06:28:30.372ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133072024-12-21T06:28:30.374ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
133082024-12-21T06:28:30.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133092024-12-21T06:28:30.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133102024-12-21T06:28:30.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133112024-12-21T06:28:30.377ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
133122024-12-21T06:28:30.377ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133132024-12-21T06:28:30.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133142024-12-21T06:28:30.382ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133152024-12-21T06:28:30.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133162024-12-21T06:28:30.389ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133172024-12-21T06:28:30.389ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
133182024-12-21T06:28:30.389ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
133192024-12-21T06:28:30.389ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
133202024-12-21T06:28:30.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
133212024-12-21T06:28:30.390ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
133222024-12-21T06:28:30.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
133232024-12-21T06:28:30.391ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
133242024-12-21T06:28:30.391ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133252024-12-21T06:28:30.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133262024-12-21T06:28:30.391ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 35.763032ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
133272024-12-21T06:28:30.392ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 36.351958ms iteration = 30 status = {"errors":[],"finish_invoked_ok":[]}
133282024-12-21T06:28:30.392ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133292024-12-21T06:28:30.393ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
133302024-12-21T06:28:30.393ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 42.735045ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
133312024-12-21T06:28:30.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
133322024-12-21T06:28:30.393ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
133332024-12-21T06:28:30.393ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
133342024-12-21T06:28:30.393ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
133352024-12-21T06:28:30.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
133362024-12-21T06:28:30.395ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133372024-12-21T06:28:30.395ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133382024-12-21T06:28:30.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133392024-12-21T06:28:30.396ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133402024-12-21T06:28:30.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
133412024-12-21T06:28:30.396ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133422024-12-21T06:28:30.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133432024-12-21T06:28:30.397ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
133442024-12-21T06:28:30.397ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
133452024-12-21T06:28:30.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
133462024-12-21T06:28:30.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 7c419228-2431-4394-af83-ea0457364b70, lookup_type: ById(7c419228-2431-4394-af83-ea0457364b70) } result = Ok(())
133472024-12-21T06:28:30.399ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133482024-12-21T06:28:30.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133492024-12-21T06:28:30.400ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133502024-12-21T06:28:30.400ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133512024-12-21T06:28:30.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133522024-12-21T06:28:30.403ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
133532024-12-21T06:28:30.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
133542024-12-21T06:28:30.403ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
133552024-12-21T06:28:30.403ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133562024-12-21T06:28:30.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133572024-12-21T06:28:30.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133582024-12-21T06:28:30.406ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
133592024-12-21T06:28:30.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133602024-12-21T06:28:30.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133612024-12-21T06:28:30.418ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.516673ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
133622024-12-21T06:28:30.425ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 7c419228-2431-4394-af83-ea0457364b70 original_time_created = 2024-12-21 06:13:54.473128 UTC target_id = 7c419228-2431-4394-af83-ea0457364b70 time_created = 2024-12-21 06:13:54.473128 UTC
133632024-12-21T06:28:30.425ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.895005ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"7c419228-2431-4394-af83-ea0457364b70","time_created":"2024-12-21T06:13:54.473128Z"}
133642024-12-21T06:28:30.433ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
133652024-12-21T06:28:30.433ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
133662024-12-21T06:28:30.433ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 82.678383ms iteration = 31 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
133672024-12-21T06:28:30.435ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133682024-12-21T06:28:30.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133692024-12-21T06:28:30.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133702024-12-21T06:28:30.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133712024-12-21T06:28:30.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
133722024-12-21T06:28:30.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
133732024-12-21T06:28:30.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 88.918317ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
133742024-12-21T06:28:30.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133752024-12-21T06:28:30.445ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
133762024-12-21T06:28:30.445ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 95.360765ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
133772024-12-21T06:28:30.446ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
133782024-12-21T06:28:30.446ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133792024-12-21T06:28:30.447ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
133802024-12-21T06:28:30.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133812024-12-21T06:28:30.447ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "19cafc02-7260-4e88-a8c1-0bfb96cc0e7a", "content-length": "26", "date": "Sat, 21 Dec 2024 06:28:30 GMT"} })
133822024-12-21T06:28:30.447ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133832024-12-21T06:28:30.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133842024-12-21T06:28:30.448ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
133852024-12-21T06:28:30.453ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
133862024-12-21T06:28:30.453ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133872024-12-21T06:28:30.454ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3089872-23bd-4677-9810-214ba3d2565d", "content-length": "26", "date": "Sat, 21 Dec 2024 06:28:30 GMT"} })
133882024-12-21T06:28:30.454ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133892024-12-21T06:28:30.455ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
133902024-12-21T06:28:30.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133912024-12-21T06:28:30.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.157228ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
133922024-12-21T06:28:30.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cf7f8320-e45e-46f1-aa3b-b101ce937c63, lookup_type: ById(cf7f8320-e45e-46f1-aa3b-b101ce937c63) } result = Ok(())
133932024-12-21T06:28:30.470ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133942024-12-21T06:28:30.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133952024-12-21T06:28:30.472ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 122.196349ms iteration = 30 status = 0
133962024-12-21T06:28:30.492ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 zone_address = fd00:1122:3344:101::2
133972024-12-21T06:28:30.492ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133982024-12-21T06:28:30.492ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "76766d95-24f2-49f6-ae51-5136a8c3a98d", "content-length": "26", "date": "Sat, 21 Dec 2024 06:28:30 GMT"} })
133992024-12-21T06:28:30.492ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
134002024-12-21T06:28:30.494ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
134012024-12-21T06:28:30.497ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 147.47913ms iteration = 34 status = {"physical_disks_added":0}
134022024-12-21T06:28:30.601ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
134032024-12-21T06:28:30.601ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcd3ede1-49eb-4842-9845-43c3a3acd650", "content-length": "691", "date": "Sat, 21 Dec 2024 06:28:30 GMT"} })
134042024-12-21T06:28:30.601ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
134052024-12-21T06:28:30.601ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
134062024-12-21T06:28:30.601ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
134072024-12-21T06:28:30.603ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 252.896434ms iteration = 31 status = {}
134082024-12-21T06:28:30.606ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
134092024-12-21T06:28:30.606ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f3cf233-8fe3-4f57-8adc-09dc842c8bb6", "content-length": "2", "date": "Sat, 21 Dec 2024 06:28:30 GMT"} })
134102024-12-21T06:28:30.607ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
134112024-12-21T06:28:30.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
134122024-12-21T06:28:30.609ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 260.338911ms iteration = 30 status = null
134132024-12-21T06:28:30.683ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 334.117466ms iteration = 30 status = {}
134142024-12-21T06:28:30.699ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
134152024-12-21T06:28:30.699ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
134162024-12-21T06:28:30.699ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3040edb9-d448-4d5b-9d0b-1adaf362953d", "content-length": "372", "date": "Sat, 21 Dec 2024 06:28:30 GMT"} })
134172024-12-21T06:28:30.699ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134182024-12-21T06:28:30.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134192024-12-21T06:28:30.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134202024-12-21T06:28:30.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134212024-12-21T06:28:30.740ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
134222024-12-21T06:28:30.740ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
134232024-12-21T06:28:30.740ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: c41a2f0b-8e71-4d5b-954d-c992ccbbfa58, rack_id: b4677cb0-5cb7-4375-8dec-b17ff2acf8f5, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(94f11562-8dda-44dd-8abe-24d1c1891273) } rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
134242024-12-21T06:28:30.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134252024-12-21T06:28:30.740ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "56d50450-cfda-487a-bf3d-3cf087506014", "date": "Sat, 21 Dec 2024 06:28:30 GMT"} })
134262024-12-21T06:28:30.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134272024-12-21T06:28:30.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134282024-12-21T06:28:30.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134292024-12-21T06:28:30.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134302024-12-21T06:28:30.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134312024-12-21T06:28:30.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134322024-12-21T06:28:30.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134332024-12-21T06:28:30.749ZINFOnexus (BackgroundTasks): VPC route manager sled cf7f8320-e45e-46f1-aa3b-b101ce937c63 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
134342024-12-21T06:28:30.749ZDEBGnexus (BackgroundTasks): client request SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
134352024-12-21T06:28:30.749ZDEBGnexus (BackgroundTasks): client response SledAgent = cf7f8320-e45e-46f1-aa3b-b101ce937c63 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3659ea4d-ed14-48e1-a0a9-e01f780988a4", "date": "Sat, 21 Dec 2024 06:28:30 GMT"} })
134362024-12-21T06:28:30.749ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
134372024-12-21T06:28:30.750ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3b0bed7-a7bf-43bc-9fbf-6febb1dbbaf2", "content-length": "134", "date": "Sat, 21 Dec 2024 06:28:30 GMT"} })
134382024-12-21T06:28:30.750ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
134392024-12-21T06:28:30.750ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 94f11562-8dda-44dd-8abe-24d1c1891273
134402024-12-21T06:28:30.750ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
134412024-12-21T06:28:30.750ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
134422024-12-21T06:28:30.750ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134432024-12-21T06:28:30.750ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134442024-12-21T06:28:30.750ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134452024-12-21T06:28:30.750ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
134462024-12-21T06:28:30.750ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134472024-12-21T06:28:30.750ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
134482024-12-21T06:28:30.750ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5
134492024-12-21T06:28:30.750ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134502024-12-21T06:28:30.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134512024-12-21T06:28:30.751ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 395.1864ms iteration = 32 status = {}
134522024-12-21T06:28:30.752ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
134532024-12-21T06:28:30.752ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a7cba39-7e8a-42d7-be55-b3f4102742ff", "content-length": "2", "date": "Sat, 21 Dec 2024 06:28:30 GMT"} })
134542024-12-21T06:28:30.752ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
134552024-12-21T06:28:30.752ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "798fb621-8121-4e7a-860d-27631e778201", "content-length": "52", "date": "Sat, 21 Dec 2024 06:28:30 GMT"} })
134562024-12-21T06:28:30.752ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch_location = Switch0
134572024-12-21T06:28:30.752ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
134582024-12-21T06:28:30.844ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e4c91940-ffe9-42b6-84b0-f56c7ae975bd", "date": "Sat, 21 Dec 2024 06:28:30 GMT"} })
134592024-12-21T06:28:30.844ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 switch = Switch0
134602024-12-21T06:28:30.844ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
134612024-12-21T06:28:30.845ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = b4677cb0-5cb7-4375-8dec-b17ff2acf8f5 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6684f7cd-37c7-4b5c-a55f-ebd8afed3a9a", "content-length": "682", "date": "Sat, 21 Dec 2024 06:28:30 GMT"} })
134622024-12-21T06:28:30.845ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134632024-12-21T06:28:30.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134642024-12-21T06:28:30.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134652024-12-21T06:28:30.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134662024-12-21T06:28:30.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134672024-12-21T06:28:30.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134682024-12-21T06:28:30.854ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134692024-12-21T06:28:30.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134702024-12-21T06:28:30.862ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 511.924899ms iteration = 30 status = {}
134712024-12-21T06:28:31.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 452ba69e-c86a-495b-be5a-11bbda4874db roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
134722024-12-21T06:28:31.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 452ba69e-c86a-495b-be5a-11bbda4874db resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
134732024-12-21T06:28:31.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = 452ba69e-c86a-495b-be5a-11bbda4874db response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
134742024-12-21T06:28:32.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d5c8ac6e-ceb2-46d1-897d-8705da4cc247 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
134752024-12-21T06:28:32.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d5c8ac6e-ceb2-46d1-897d-8705da4cc247 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
134762024-12-21T06:28:32.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = d5c8ac6e-ceb2-46d1-897d-8705da4cc247 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
134772024-12-21T06:28:33.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ef249d34-93ae-47cc-9e51-361d3acd3958 roles = RoleSet { roles: {} } uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
134782024-12-21T06:28:33.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ef249d34-93ae-47cc-9e51-361d3acd3958 resource = Database result = Ok(()) uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
134792024-12-21T06:28:33.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2789 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:41384 req_id = ef249d34-93ae-47cc-9e51-361d3acd3958 response_code = 200 uri = /probes/cf7f8320-e45e-46f1-aa3b-b101ce937c63
134802024-12-21T06:28:33.968ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1427 local_addr = [fd00:1122:3344:101::c]:64858 method = GET remote_addr = [fd00:1122:3344:101::d]:45185 req_id = e73d6672-f5e6-4201-b3bc-4d9de8f58809 response_code = 200 uri = /0795bbeb-c8d5-4d73-93c6-4d2d747fdfcb